Jul 13 20:22:36 devstack cinder-volume[75906]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 13 20:22:36 devstack cinder-volume[75906]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 13 20:22:36 devstack cinder-volume[75906]: we strongly recommend against using it for new projects. Jul 13 20:22:36 devstack cinder-volume[75906]: If you are already using Eventlet, we recommend migrating to a different Jul 13 20:22:36 devstack cinder-volume[75906]: framework. For more detail see Jul 13 20:22:36 devstack cinder-volume[75906]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 13 20:22:36 devstack cinder-volume[75906]: import eventlet # noqa Jul 13 20:22:39 devstack cinder-volume[75906]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75906) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 13 20:22:39 devstack cinder-volume[75906]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75906) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 13 20:22:39 devstack cinder-volume[75906]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75906) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 13 20:22:40 devstack cinder-volume[75906]: INFO dbcounter [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Registered counter for database cinder Jul 13 20:22:40 devstack cinder-volume[75906]: DEBUG oslo_db.sqlalchemy.engines [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75906) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 20:22:40 devstack cinder-volume[75906]: DEBUG dbcounter [-] [75906] Writer thread running {{(pid=75906) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 13 20:22:40 devstack cinder-volume[75906]: INFO cinder.rpc [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 13 20:22:40 devstack cinder-volume[75906]: INFO cinder.rpc [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 13 20:22:40 devstack cinder-volume[75906]: DEBUG oslo_db.sqlalchemy.engines [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75906) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 20:22:40 devstack cinder-volume[75906]: INFO cinder.volume.manager [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Determined volume DB was empty at startup. Jul 13 20:22:40 devstack cinder-volume[75906]: DEBUG cinder.volume.manager [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75906) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 13 20:22:40 devstack cinder-volume[75906]: INFO cinder.volume.manager [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 13 20:22:40 devstack cinder-volume[75906]: WARNING stevedore.named [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 13 20:22:40 devstack cinder-volume[75906]: WARNING castellan.key_manager [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 13 20:22:40 devstack cinder-volume[75906]: WARNING cinder.keymgr.conf_key_mgr [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 13 20:22:40 devstack cinder-volume[75906]: DEBUG cinder.volume.drivers.lvm [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75906) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 13 20:22:40 devstack cinder-volume[75906]: DEBUG oslo_concurrency.processutils [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75906) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_concurrency.processutils [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] CMD "cinder-rtstool verify" returned: 0 in 0.408s {{(pid=75906) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_db.sqlalchemy.engines [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75906) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 20:22:41 devstack cinder-volume[75906]: INFO cinder.rpc [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 13 20:22:41 devstack cinder-volume[75906]: INFO cinder.rpc [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 13 20:22:41 devstack cinder-volume[75906]: WARNING stevedore.named [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 13 20:22:41 devstack cinder-volume[75906]: WARNING castellan.key_manager [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 13 20:22:41 devstack cinder-volume[75906]: INFO cinder.volume.manager [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_db.sqlalchemy.engines [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75906) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 20:22:41 devstack cinder-volume[75906]: INFO oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Starting 1 workers Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Started child 76042 {{(pid=75906) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Full set of CONF: {{(pid=75906) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] ******************************************************************************** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Configuration options gathered from: {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] ================================================================================ {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] allow_availability_zone_fallback = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] allow_compression_on_image_upload = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] allowed_direct_url_schemes = [] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] api_rate_limit = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] auth_strategy = keystone {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] az_cache_duration = 3600 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_availability_zone = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_host = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_name = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_stats_polling_interval = 60 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backup_api_class = cinder.backup.api.API {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backup_name_template = backup-%s {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backup_use_same_host = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[76042]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backup_use_temp_snapshot = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] chap_password = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] chap_username = {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cinder_internal_tenant_project_id = ab6b2d5063084846964a49a4d7d0d496 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cinder_internal_tenant_user_id = 9966e23979494d5bb3808cae4b4a97fa {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cloned_volume_same_az = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cluster = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] compression_format = gzip {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] compute_api_class = cinder.compute.nova.API {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] config_dir = [] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] config_source = [] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] control_exchange = openstack {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] debug = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] default_availability_zone = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] default_group_type = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] default_volume_type = lvmdriver-1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] disk_geometry = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] driver_client_cert = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] driver_client_cert_key = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] driver_data_namespace = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] driver_ssl_cert_path = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] driver_ssl_cert_verify = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] driver_use_ssl = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] enable_force_upload = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] enable_new_services = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] enable_unsupported_driver = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] enabled_backends = ['lvmdriver-1'] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] enforce_multipath_for_image_xfer = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] filter_function = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance_api_insecure = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance_api_servers = ['http://192.168.122.212/image'] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance_api_ssl_compression = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance_ca_certificates_file = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance_catalog_info = image:glance:publicURL {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance_certfile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance_keyfile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance_num_retries = 3 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance_request_timeout = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] goodness_function = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] graceful_shutdown_timeout = 5 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] group_api_class = cinder.group.api.API {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[76042]: INFO cinder.volume.manager [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 13 20:22:41 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] host = devstack {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] image_compress_on_upload = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] image_conversion_address_space_limit = 1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] image_conversion_cpu_limit = 60 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] image_conversion_disable = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] image_upload_use_cinder_backend = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] image_upload_use_internal_tenant = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] image_volume_cache_enabled = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] image_volume_cache_max_count = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] image_volume_cache_max_size_gb = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] init_host_max_objects_retrieval = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] instance_format = [instance: %(uuid)s] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] iscsi_target_flags = {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] iscsi_write_cache = on {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] iser_helper = tgtadm {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] iser_ip_address = 192.168.122.212 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] iser_port = 3260 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] log_color = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] log_config_append = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] log_dir = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] log_file = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] log_options = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] log_rotate_interval = 1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] log_rotate_interval_type = days {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] log_rotation_type = none {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] max_age = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] max_logfile_count = 30 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] max_logfile_size_mb = 200 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] max_over_subscription_ratio = 20.0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] message_reap_interval = 86400 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] message_ttl = 2592000 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] migration_create_volume_timeout_secs = 300 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] monkey_patch = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] monkey_patch_modules = [] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] my_ip = 192.168.122.212 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] no_snapshot_gb_quota = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] num_iser_scan_tries = 3 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] num_shell_tries = 3 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] num_volume_device_scan_tries = 3 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] nvmeof_conn_info_version = 1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] nvmet_ns_id = 10 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] nvmet_port_id = 1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] osapi_max_limit = 1000 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] osapi_volume_ext_list = [] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] osapi_volume_listen = 0.0.0.0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] osapi_volume_listen_port = 8776 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] osapi_volume_use_ssl = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] osapi_volume_workers = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] per_volume_size_limit = -1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] periodic_fuzzy_delay = 60 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] periodic_interval = 60 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] project_id_regex = [0-9a-f\-]+ {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] public_endpoint = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] publish_errors = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] quota_backup_gigabytes = 1000 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] quota_backups = 10 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] quota_gigabytes = 1000 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] quota_groups = 10 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] quota_snapshots = 10 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] quota_volumes = 10 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] rate_limit_burst = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] rate_limit_except_level = CRITICAL {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] rate_limit_interval = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] reinit_driver_count = 3 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] replication_device = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] report_discard_supported = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] report_interval = 120 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] reservation_clean_interval = 86400 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] reservation_expire = 86400 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] reserved_image_namespaces = [] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] reserved_percentage = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] rpc_response_timeout = 120 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] run_external_periodic_tasks = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] scst_target_driver = iscsi {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] scst_target_iqn_name = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] service_down_time = 720 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] shell_completion = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] snapshot_name_template = snapshot-%s {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] snapshot_same_host = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] split_loggers = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] state_path = /opt/stack/data/cinder {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] storage_availability_zone = nova {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] storage_protocol = iSCSI {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] syslog_log_facility = LOG_USER {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] target_helper = lioadm {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] target_ip_address = 192.168.122.212 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] target_port = 3260 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] target_protocol = iscsi {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] target_secondary_ip_addresses = [] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] trace_flags = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] transfer_api_class = cinder.transfer.api.API {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] transport_url = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] until_refresh = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] use_chap_auth = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] use_default_quota_class = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] use_journal = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] use_json = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] use_multipath_for_image_xfer = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] use_stderr = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] use_syslog = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] verify_glance_signatures = enabled {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] volume_api_class = cinder.volume.api.API {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] volume_backend_name = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] volume_clear = zero {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] volume_clear_ionice = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] volume_clear_size = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] volume_copy_bps_limit = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] volume_dd_blocksize = 1M {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] volume_name_template = volume-%s {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] volume_service_inithost_offload = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] volume_usage_audit_period = month {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] zoning_mode = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_concurrency.disable_process_locking = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.auth_section = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.auth_type = password {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.auth_version = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.cache = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.certfile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.delay_auth_decision = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.http_connect_timeout = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.include_service_catalog = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.insecure = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.interface = public {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.keyfile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.memcache_password = {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.memcache_username = {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.region_name = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.service_token_roles_required = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.service_type = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.token_cache_time = 300 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.212/identity {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.backend = dogpile.cache.null {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.backend_argument = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.backend_expiration_time = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.config_prefix = cache.oslo {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.debug_cache_backend = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.enable_retry_client = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.enable_socket_keepalive = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.enabled = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.expiration_time = 600 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.hashclient_retry_attempts = 2 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.memcache_dead_retry = 300 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.memcache_pool_maxsize = 10 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.memcache_sasl_enabled = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.password = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.proxies = [] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.redis_db = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.redis_sentinel_service_name = mymaster {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.redis_server = localhost:6379 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.retry_attempts = 2 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.retry_delay = 0.0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.socket_keepalive_count = 1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.socket_keepalive_idle = 1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.socket_keepalive_interval = 1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.socket_timeout = 1.0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.tls_allowed_ciphers = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.tls_cafile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.tls_certfile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.tls_enabled = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.tls_keyfile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cache.username = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] coordination.backend_url = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.asyncio_connection = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.asyncio_slave_connection = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.backend = sqlalchemy {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.connection = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.connection_debug = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.connection_parameters = {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.connection_recycle_time = 3600 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.connection_trace = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.db_inc_retry_interval = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.db_max_retries = 20 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.db_max_retry_interval = 10 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.db_retry_interval = 1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.max_overflow = 50 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.max_pool_size = 5 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.max_retries = 10 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.mysql_wsrep_sync_wait = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.pool_timeout = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.retry_interval = 10 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.slave_connection = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.sqlite_synchronous = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.synchronous_reader = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] database.use_db_reconnect = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] profiler.connection_string = messaging:// {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] profiler.enabled = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] profiler.es_doc_type = notification {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] profiler.es_scroll_size = 10000 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] profiler.es_scroll_time = 2m {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] profiler.filter_error_trace = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] profiler.hmac_keys = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] profiler.sentinel_service_name = mymaster {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] profiler.socket_timeout = 0.1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] profiler.trace_requests = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] profiler.trace_sqlalchemy = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] profiler_jaeger.process_tags = {} {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] profiler_jaeger.service_name_prefix = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] profiler_otlp.service_name_prefix = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_policy.enforce_new_defaults = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_policy.enforce_scope = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_policy.policy_default_rule = default {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_policy.policy_file = policy.yaml {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_policy.remote_timeout = 60.0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] privsep_osbrick.group = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] privsep_osbrick.helper_command = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] privsep_osbrick.user = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cinder_sys_admin.group = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cinder_sys_admin.helper_command = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack sudo[76046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 13 20:22:41 devstack sudo[76046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] cinder_sys_admin.user = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] service_user.auth_section = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] service_user.auth_type = password {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] service_user.cafile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] service_user.certfile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] service_user.collect_timing = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] service_user.insecure = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] service_user.keyfile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] service_user.send_service_user_token = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] service_user.split_loggers = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] service_user.timeout = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance.auth_section = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance.auth_type = password {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance.certfile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance.collect_timing = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance.insecure = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance.keyfile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance.region_name = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance.split_loggers = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] glance.timeout = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.backend_availability_zone = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.chap_password = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.chap_username = {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.disk_geometry = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.driver_client_cert = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.driver_client_cert_key = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.driver_data_namespace = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.driver_use_ssl = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.enable_unsupported_driver = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.extra_capabilities = {} {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.filter_function = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.goodness_function = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.iscsi_target_flags = {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.iscsi_write_cache = on {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.iser_helper = tgtadm {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.iser_ip_address = 192.168.122.212 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.iser_port = 3260 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.lvm_mirrors = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.lvm_share_target = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.lvm_type = auto {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.num_shell_tries = 3 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.nvmet_port_id = 1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.replication_device = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.report_discard_supported = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.reserved_percentage = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.scst_target_driver = iscsi {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.scst_target_iqn_name = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.storage_protocol = iSCSI {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.target_helper = tgtadm {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.target_ip_address = 192.168.122.212 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.target_port = 3260 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.target_protocol = iscsi {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.trace_flags = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.unique_fqdn_network = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.use_chap_auth = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.volume_backend_name = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.volume_clear = zero {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.volume_clear_ionice = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.volume_clear_size = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.volume_group = cinder-volumes {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_reports.file_event_handler = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_reports.log_dir = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.backend_availability_zone = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.backend_host = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.chap_password = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.chap_username = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.chiscsi_conf = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.disk_geometry = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.driver_client_cert = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.driver_data_namespace = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.driver_use_ssl = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.extra_capabilities = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.filter_function = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.goodness_function = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.iser_helper = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.iser_ip_address = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.iser_port = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.iser_target_prefix = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.lvm_conf_file = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.lvm_mirrors = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.lvm_share_target = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.lvm_type = auto {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.num_shell_tries = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.nvmet_port_id = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.replication_device = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.report_discard_supported = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.reserved_percentage = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.scst_target_driver = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.storage_protocol = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.target_helper = lioadm {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.target_ip_address = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.target_port = 3260 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.target_protocol = iscsi {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.trace_flags = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.use_chap_auth = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.volume_clear = zero {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.volume_clear_size = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] lvmdriver-1.volumes_dir = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.ssl = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.ssl_version = {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_notifications.driver = [] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_notifications.retry = -1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] oslo_messaging_notifications.transport_url = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] key_manager.fixed_key = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican.barbican_api_version = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican.barbican_endpoint = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican.barbican_endpoint_type = public {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican.barbican_region_name = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican.cafile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican.certfile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican.collect_timing = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican.insecure = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican.keyfile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican.number_of_retries = 60 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican.retry_delay = 1 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican.send_service_user_token = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican.split_loggers = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican.timeout = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican.verify_ssl = True {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican.verify_ssl_path = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican_service_user.auth_section = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican_service_user.auth_type = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican_service_user.cafile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican_service_user.certfile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican_service_user.collect_timing = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican_service_user.insecure = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican_service_user.keyfile = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican_service_user.split_loggers = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] barbican_service_user.timeout = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] vault.approle_role_id = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] vault.approle_secret_id = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] vault.auth_method = approle {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] vault.auth_path = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] vault.kv_mountpoint = secret {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] vault.kv_path = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] vault.kv_version = 2 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] vault.namespace = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] vault.root_token_id = **** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] vault.ssl_ca_crt_file = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] vault.timeout = 60.0 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] vault.token_file = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] vault.token_role = None {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] vault.use_ssl = False {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:22:41 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] ******************************************************************************** {{(pid=75906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 13 20:22:41 devstack sudo[76046]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:41 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.336s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:41 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:41 devstack sudo[76139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 20:22:41 devstack sudo[76139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:42 devstack sudo[76139]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:42 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.259s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:42 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:22:42 devstack cinder-volume[76042]: INFO cinder.brick.local_dev.lvm [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 13 20:22:42 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:42 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:42 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:42 devstack sudo[76243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 20:22:42 devstack sudo[76243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:42 devstack sudo[76243]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:42 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:42 devstack cinder-volume[76042]: DEBUG cinder.brick.local_dev.lvm [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76042) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 13 20:22:42 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:42 devstack sudo[76327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 20:22:42 devstack sudo[76327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:42 devstack sudo[76327]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:42 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.541s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:42 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:42 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:42 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:42 devstack sudo[76524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 20:22:42 devstack sudo[76524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:43 devstack sudo[76524]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:43 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.316s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:43 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:43 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:43 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:43 devstack sudo[76652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 13 20:22:43 devstack sudo[76652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:43 devstack sudo[76652]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:43 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.259s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:43 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:43 devstack sudo[76655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 20:22:43 devstack sudo[76655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:43 devstack sudo[76655]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:43 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:43 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:43 devstack sudo[76738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 20:22:43 devstack sudo[76738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:44 devstack sudo[76738]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:44 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:44 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:44 devstack sudo[76741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 20:22:44 devstack sudo[76741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:44 devstack sudo[76741]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:44 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:44 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:44 devstack sudo[76770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 20:22:44 devstack sudo[76770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:44 devstack sudo[76770]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:44 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:44 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:44 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:44 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:44 devstack sudo[76834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 20:22:44 devstack sudo[76834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:44 devstack sudo[76834]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:44 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:44 devstack cinder-volume[76042]: INFO cinder.volume.drivers.lvm [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 13 20:22:44 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:45 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:45 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:45 devstack sudo[76838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 20:22:45 devstack sudo[76838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:45 devstack sudo[76838]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:45 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:45 devstack cinder-volume[76042]: DEBUG cinder.volume.drivers.lvm [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Updating volume stats {{(pid=76042) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 13 20:22:45 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:45 devstack sudo[76842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 20:22:45 devstack sudo[76842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:45 devstack sudo[76842]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:45 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:45 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:45 devstack sudo[76845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 20:22:45 devstack sudo[76845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:45 devstack sudo[76845]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:45 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:45 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:45 devstack sudo[76848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 20:22:45 devstack sudo[76848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:46 devstack sudo[76848]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:46 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:46 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:46 devstack sudo[76851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 20:22:46 devstack sudo[76851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:46 devstack sudo[76851]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:46 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:46 devstack cinder-volume[76042]: INFO cinder.volume.driver [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Driver hasn't implemented _init_vendor_properties() Jul 13 20:22:46 devstack cinder-volume[76042]: DEBUG cinder.volume.driver [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76042) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 13 20:22:46 devstack cinder-volume[76042]: DEBUG oslo_db.sqlalchemy.engines [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76042) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 20:22:46 devstack cinder-volume[76042]: DEBUG dbcounter [-] [76042] Writer thread running {{(pid=76042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 13 20:22:46 devstack cinder-volume[76042]: DEBUG cinder.db.api [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Building query based on filter {{(pid=76042) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 13 20:22:46 devstack cinder-volume[76042]: DEBUG cinder.image.image_utils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76042) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 13 20:22:46 devstack cinder-volume[76042]: INFO cinder.keymgr.migration [None req-bfaac696-499a-45f8-ba86-3443c0726a39 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 13 20:22:46 devstack cinder-volume[76042]: DEBUG cinder.volume.drivers.lvm [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Updating volume stats {{(pid=76042) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 13 20:22:46 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:46 devstack sudo[76854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 20:22:46 devstack sudo[76854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:46 devstack sudo[76854]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:46 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:46 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:46 devstack sudo[76859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 20:22:46 devstack sudo[76859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:47 devstack sudo[76859]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:47 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:47 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:47 devstack sudo[76868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 20:22:47 devstack sudo[76868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:47 devstack sudo[76868]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:47 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:47 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:47 devstack sudo[76871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 20:22:47 devstack sudo[76871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:47 devstack sudo[76871]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:47 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:47 devstack cinder-volume[76042]: DEBUG cinder.manager [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Notifying Schedulers of capabilities ... {{(pid=76042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:22:47 devstack cinder-volume[76042]: INFO cinder.volume.manager [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Driver initialization completed successfully. Jul 13 20:22:47 devstack cinder-volume[76042]: INFO cinder.manager [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Initiating service 2 cleanup Jul 13 20:22:47 devstack cinder-volume[76042]: INFO cinder.manager [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Service 2 cleanup completed. Jul 13 20:22:47 devstack cinder-volume[76042]: DEBUG cinder.service [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Creating RPC server for service cinder-volume {{(pid=76042) start /opt/stack/cinder/cinder/service.py:231}} Jul 13 20:22:47 devstack cinder-volume[76042]: DEBUG cinder.service [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76042) start /opt/stack/cinder/cinder/service.py:237}} Jul 13 20:22:47 devstack cinder-volume[76042]: INFO cinder.volume.manager [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 13 20:22:47 devstack cinder-volume[76042]: DEBUG cinder.volume.drivers.lvm [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Updating volume stats {{(pid=76042) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 13 20:22:47 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:47 devstack sudo[76876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 20:22:47 devstack sudo[76876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:48 devstack sudo[76876]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:48 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:48 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:48 devstack sudo[76879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 20:22:48 devstack sudo[76879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:48 devstack sudo[76879]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:48 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:48 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:48 devstack sudo[76882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 20:22:48 devstack sudo[76882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:48 devstack sudo[76882]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:48 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:48 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:22:48 devstack sudo[76885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 20:22:48 devstack sudo[76885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:22:48 devstack sudo[76885]: pam_unix(sudo:session): session closed for user root Jul 13 20:22:48 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:22:48 devstack cinder-volume[76042]: INFO cinder.volume.manager [None req-a7644f55-5ba6-49c4-aa9b-2a10ee514c1f None None] Driver post RPC initialization completed successfully. Jul 13 20:22:51 devstack cinder-volume[75906]: DEBUG dbcounter [-] [75906] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75906) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:22:57 devstack cinder-volume[76042]: DEBUG oslo_service.periodic_task [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running periodic task VolumeManager._thread_info {{(pid=76042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:22:57 devstack cinder-volume[76042]: DEBUG cinder.volume.manager [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] thread count: 6 {{(pid=76042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:22:57 devstack cinder-volume[76042]: DEBUG cinder.volume.manager [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] thread info: [<_MainThread(MainThread, started 130617318416512)>, , , , , ] {{(pid=76042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:22:58 devstack cinder-volume[76042]: DEBUG dbcounter [-] [76042] Writing DB stats cinder:SELECT=3 {{(pid=76042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:22:58 devstack cinder-volume[76042]: DEBUG dbcounter [-] [76042] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:23:57 devstack cinder-volume[76042]: DEBUG oslo_service.periodic_task [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:23:57 devstack cinder-volume[76042]: DEBUG cinder.volume.drivers.lvm [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Updating volume stats {{(pid=76042) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 13 20:23:57 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:23:57 devstack sudo[78919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 20:23:57 devstack sudo[78919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:23:58 devstack sudo[78919]: pam_unix(sudo:session): session closed for user root Jul 13 20:23:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:23:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:23:58 devstack sudo[78922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 20:23:58 devstack sudo[78922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:23:58 devstack sudo[78922]: pam_unix(sudo:session): session closed for user root Jul 13 20:23:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:23:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:23:58 devstack sudo[78925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 20:23:58 devstack sudo[78925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:23:58 devstack sudo[78925]: pam_unix(sudo:session): session closed for user root Jul 13 20:23:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:23:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:23:58 devstack sudo[78928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 20:23:58 devstack sudo[78928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:23:58 devstack sudo[78928]: pam_unix(sudo:session): session closed for user root Jul 13 20:23:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:23:58 devstack cinder-volume[76042]: DEBUG cinder.manager [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Notifying Schedulers of capabilities ... {{(pid=76042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:23:58 devstack cinder-volume[76042]: DEBUG oslo_service.periodic_task [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running periodic task VolumeManager._thread_info {{(pid=76042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:23:58 devstack cinder-volume[76042]: DEBUG cinder.volume.manager [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] thread count: 6 {{(pid=76042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:23:58 devstack cinder-volume[76042]: DEBUG cinder.volume.manager [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] thread info: [<_MainThread(MainThread, started 130617318416512)>, , , , , ] {{(pid=76042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:24:57 devstack cinder-volume[76042]: DEBUG oslo_service.periodic_task [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:24:57 devstack cinder-volume[76042]: DEBUG cinder.volume.drivers.lvm [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Updating volume stats {{(pid=76042) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 13 20:24:57 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:24:57 devstack sudo[82208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 20:24:57 devstack sudo[82208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:24:58 devstack sudo[82208]: pam_unix(sudo:session): session closed for user root Jul 13 20:24:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:24:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:24:58 devstack sudo[82211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 20:24:58 devstack sudo[82211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:24:58 devstack sudo[82211]: pam_unix(sudo:session): session closed for user root Jul 13 20:24:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:24:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:24:58 devstack sudo[82214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 20:24:58 devstack sudo[82214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:24:58 devstack sudo[82214]: pam_unix(sudo:session): session closed for user root Jul 13 20:24:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:24:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:24:58 devstack sudo[82218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 20:24:58 devstack sudo[82218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:24:58 devstack cinder-volume[76042]: DEBUG dbcounter [-] [76042] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:24:58 devstack sudo[82218]: pam_unix(sudo:session): session closed for user root Jul 13 20:24:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:24:58 devstack cinder-volume[76042]: DEBUG cinder.manager [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Notifying Schedulers of capabilities ... {{(pid=76042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:24:58 devstack cinder-volume[76042]: DEBUG oslo_service.periodic_task [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running periodic task VolumeManager._thread_info {{(pid=76042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:24:58 devstack cinder-volume[76042]: DEBUG cinder.volume.manager [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] thread count: 6 {{(pid=76042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:24:58 devstack cinder-volume[76042]: DEBUG cinder.volume.manager [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] thread info: [<_MainThread(MainThread, started 130617318416512)>, , , , , ] {{(pid=76042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:25:57 devstack cinder-volume[76042]: DEBUG oslo_service.periodic_task [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:25:57 devstack cinder-volume[76042]: DEBUG cinder.volume.drivers.lvm [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Updating volume stats {{(pid=76042) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 13 20:25:57 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:25:57 devstack sudo[84662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 20:25:57 devstack sudo[84662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:25:58 devstack sudo[84662]: pam_unix(sudo:session): session closed for user root Jul 13 20:25:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:25:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:25:58 devstack sudo[84670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 20:25:58 devstack sudo[84670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:25:58 devstack sudo[84670]: pam_unix(sudo:session): session closed for user root Jul 13 20:25:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:25:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:25:58 devstack sudo[84692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 20:25:58 devstack sudo[84692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:25:58 devstack sudo[84692]: pam_unix(sudo:session): session closed for user root Jul 13 20:25:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:25:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:25:58 devstack sudo[84704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 20:25:58 devstack sudo[84704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:25:58 devstack sudo[84704]: pam_unix(sudo:session): session closed for user root Jul 13 20:25:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:25:58 devstack cinder-volume[76042]: DEBUG cinder.manager [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Notifying Schedulers of capabilities ... {{(pid=76042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:26:57 devstack cinder-volume[76042]: DEBUG oslo_service.periodic_task [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:26:57 devstack cinder-volume[76042]: DEBUG cinder.volume.drivers.lvm [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Updating volume stats {{(pid=76042) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 13 20:26:57 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:26:57 devstack sudo[85983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 20:26:57 devstack sudo[85983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:26:58 devstack sudo[85983]: pam_unix(sudo:session): session closed for user root Jul 13 20:26:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:26:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:26:58 devstack sudo[85991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 20:26:58 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:26:58 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root Jul 13 20:26:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:26:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:26:58 devstack sudo[85994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 20:26:58 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:26:58 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root Jul 13 20:26:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:26:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:26:58 devstack sudo[86003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 20:26:58 devstack sudo[86003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:26:58 devstack cinder-volume[76042]: DEBUG dbcounter [-] [76042] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:26:58 devstack sudo[86003]: pam_unix(sudo:session): session closed for user root Jul 13 20:26:58 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:26:58 devstack cinder-volume[76042]: DEBUG cinder.manager [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Notifying Schedulers of capabilities ... {{(pid=76042) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:26:58 devstack cinder-volume[76042]: DEBUG oslo_service.periodic_task [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] Running periodic task VolumeManager._thread_info {{(pid=76042) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:26:58 devstack cinder-volume[76042]: DEBUG cinder.volume.manager [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] thread count: 6 {{(pid=76042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:26:58 devstack cinder-volume[76042]: DEBUG cinder.volume.manager [None req-94f99264-b921-45c6-85fc-245a37e0b116 None None] thread info: [<_MainThread(MainThread, started 130617318416512)>, , , , , ] {{(pid=76042) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:27:19 devstack cinder-volume[75906]: INFO oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Caught SIGTERM, stopping children Jul 13 20:27:19 devstack cinder-volume[75906]: DEBUG oslo_concurrency.lockutils [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Acquiring lock "singleton_lock" {{(pid=75906) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 13 20:27:19 devstack cinder-volume[75906]: DEBUG oslo_concurrency.lockutils [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Acquired lock "singleton_lock" {{(pid=75906) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 13 20:27:19 devstack cinder-volume[75906]: DEBUG oslo_concurrency.lockutils [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Releasing lock "singleton_lock" {{(pid=75906) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 13 20:27:19 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Stop services. {{(pid=75906) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 13 20:27:19 devstack cinder-volume[75906]: DEBUG oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Killing children. {{(pid=75906) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 13 20:27:19 devstack cinder-volume[75906]: INFO oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Waiting on 1 children to exit Jul 13 20:27:22 devstack cinder-volume[76042]: DEBUG oslo_concurrency.lockutils [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Acquiring lock "singleton_lock" {{(pid=76042) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 13 20:27:22 devstack cinder-volume[76042]: DEBUG oslo_concurrency.lockutils [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Acquired lock "singleton_lock" {{(pid=76042) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 13 20:27:22 devstack cinder-volume[76042]: DEBUG oslo_concurrency.lockutils [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Releasing lock "singleton_lock" {{(pid=76042) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 13 20:27:22 devstack cinder-volume[76042]: WARNING amqp [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 13 20:27:22 devstack cinder-volume[76042]: WARNING amqp [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 13 20:27:22 devstack cinder-volume[75906]: INFO oslo_service.backend._eventlet.service [None req-2bfec004-0bd5-49ec-b06c-3bd2b1efdb5f None None] Child 76042 exited with status 0 Jul 13 20:27:23 devstack cinder-volume[86546]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 13 20:27:23 devstack cinder-volume[86546]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 13 20:27:23 devstack cinder-volume[86546]: we strongly recommend against using it for new projects. Jul 13 20:27:23 devstack cinder-volume[86546]: If you are already using Eventlet, we recommend migrating to a different Jul 13 20:27:23 devstack cinder-volume[86546]: framework. For more detail see Jul 13 20:27:23 devstack cinder-volume[86546]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 13 20:27:23 devstack cinder-volume[86546]: import eventlet # noqa Jul 13 20:27:25 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86546) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 13 20:27:25 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86546) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 13 20:27:25 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86546) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 13 20:27:25 devstack cinder-volume[86546]: INFO dbcounter [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Registered counter for database cinder Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_db.sqlalchemy.engines [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86546) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG dbcounter [-] [86546] Writer thread running {{(pid=86546) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 13 20:27:26 devstack cinder-volume[86546]: INFO cinder.rpc [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 13 20:27:26 devstack cinder-volume[86546]: INFO cinder.rpc [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_db.sqlalchemy.engines [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86546) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 20:27:26 devstack cinder-volume[86546]: INFO cinder.volume.manager [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Determined volume DB was empty at startup. Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG cinder.volume.manager [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86546) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 13 20:27:26 devstack cinder-volume[86546]: INFO cinder.volume.manager [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 13 20:27:26 devstack cinder-volume[86546]: WARNING stevedore.named [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 13 20:27:26 devstack cinder-volume[86546]: WARNING castellan.key_manager [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 13 20:27:26 devstack cinder-volume[86546]: WARNING cinder.keymgr.conf_key_mgr [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 13 20:27:26 devstack cinder-volume[86546]: INFO cinder.volume.manager [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_db.sqlalchemy.engines [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86546) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 20:27:26 devstack cinder-volume[86546]: INFO oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Starting 1 workers Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Started child 86801 {{(pid=86546) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Full set of CONF: {{(pid=86546) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] ******************************************************************************** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Configuration options gathered from: {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] ================================================================================ {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] allow_availability_zone_fallback = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] allow_compression_on_image_upload = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] allowed_direct_url_schemes = [] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] api_rate_limit = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] auth_strategy = keystone {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_availability_zone = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_host = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_name = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_stats_polling_interval = 60 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backup_api_class = cinder.backup.api.API {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backup_name_template = backup-%s {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backup_use_same_host = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backup_use_temp_snapshot = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] chap_password = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86801]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] chap_username = {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cinder_internal_tenant_project_id = ab6b2d5063084846964a49a4d7d0d496 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cinder_internal_tenant_user_id = 9966e23979494d5bb3808cae4b4a97fa {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cluster = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] compression_format = gzip {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] compute_api_class = cinder.compute.nova.API {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] config_dir = [] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] config_source = [] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] control_exchange = openstack {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] debug = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] default_availability_zone = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] default_group_type = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] default_volume_type = QuobyteHD {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] disk_geometry = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] driver_client_cert = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] driver_client_cert_key = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] driver_data_namespace = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] driver_ssl_cert_path = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] driver_ssl_cert_verify = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] driver_use_ssl = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] enable_new_services = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] enable_unsupported_driver = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] enabled_backends = ['QuobyteHD'] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] enforce_multipath_for_image_xfer = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] filter_function = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance_api_insecure = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance_api_servers = ['http://192.168.122.212/image'] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance_api_ssl_compression = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance_ca_certificates_file = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance_catalog_info = image:glance:publicURL {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance_certfile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance_keyfile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance_num_retries = 3 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance_request_timeout = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] goodness_function = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] graceful_shutdown_timeout = 5 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] group_api_class = cinder.group.api.API {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] host = devstack {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] image_compress_on_upload = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] image_conversion_address_space_limit = 1 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] image_conversion_cpu_limit = 60 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] image_conversion_disable = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] image_upload_use_cinder_backend = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] image_upload_use_internal_tenant = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] image_volume_cache_enabled = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] image_volume_cache_max_count = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] image_volume_cache_max_size_gb = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] init_host_max_objects_retrieval = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] instance_format = [instance: %(uuid)s] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] iscsi_target_flags = {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] iscsi_write_cache = on {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] iser_helper = tgtadm {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] iser_ip_address = 192.168.122.212 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] iser_port = 3260 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] log_color = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] log_config_append = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] log_dir = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] log_file = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] log_options = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] log_rotate_interval = 1 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] log_rotate_interval_type = days {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] log_rotation_type = none {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] max_age = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] max_logfile_count = 30 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] max_logfile_size_mb = 200 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] max_over_subscription_ratio = 20.0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] message_reap_interval = 86400 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] message_ttl = 2592000 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] migration_create_volume_timeout_secs = 300 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] monkey_patch = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] monkey_patch_modules = [] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] my_ip = 192.168.122.212 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] no_snapshot_gb_quota = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] num_iser_scan_tries = 3 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] num_shell_tries = 3 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] num_volume_device_scan_tries = 3 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] nvmeof_conn_info_version = 1 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] nvmet_ns_id = 10 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] nvmet_port_id = 1 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] osapi_max_limit = 1000 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] osapi_volume_ext_list = [] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] osapi_volume_listen = 0.0.0.0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] osapi_volume_listen_port = 8776 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] osapi_volume_use_ssl = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] osapi_volume_workers = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] per_volume_size_limit = -1 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] periodic_fuzzy_delay = 60 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] periodic_interval = 60 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] project_id_regex = [0-9a-f\-]+ {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] public_endpoint = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] publish_errors = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] quota_backup_gigabytes = 1000 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] quota_backups = 10 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] quota_gigabytes = 1000 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] quota_groups = 10 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] quota_snapshots = 10 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] quota_volumes = 10 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] rate_limit_burst = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] rate_limit_except_level = CRITICAL {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] rate_limit_interval = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] reinit_driver_count = 3 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] replication_device = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] report_discard_supported = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] report_interval = 120 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] reservation_clean_interval = 86400 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] reservation_expire = 86400 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] reserved_image_namespaces = [] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] reserved_percentage = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] rpc_response_timeout = 120 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] run_external_periodic_tasks = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] scst_target_driver = iscsi {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] scst_target_iqn_name = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] service_down_time = 720 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] shell_completion = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] snapshot_name_template = snapshot-%s {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] split_loggers = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] state_path = /opt/stack/data/cinder {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] storage_availability_zone = nova {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] storage_protocol = iSCSI {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] syslog_log_facility = LOG_USER {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] target_helper = lioadm {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] target_ip_address = 192.168.122.212 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] target_port = 3260 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] target_protocol = iscsi {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] target_secondary_ip_addresses = [] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] trace_flags = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] transfer_api_class = cinder.transfer.api.API {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] transport_url = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] until_refresh = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] use_chap_auth = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] use_default_quota_class = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] use_journal = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] use_json = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Starting volume driver QuobyteDriver (1.1.14) Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] use_multipath_for_image_xfer = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86801) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] use_stderr = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] use_syslog = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] verify_glance_signatures = enabled {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] volume_api_class = cinder.volume.api.API {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] volume_backend_name = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] volume_clear = zero {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] volume_clear_ionice = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] volume_clear_size = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] volume_copy_bps_limit = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] volume_dd_blocksize = 1M {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] volume_name_template = volume-%s {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] volume_service_inithost_offload = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] volume_usage_audit_period = month {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] zoning_mode = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_concurrency.disable_process_locking = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.auth_section = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.auth_type = password {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.auth_version = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.cache = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.certfile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.delay_auth_decision = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.http_connect_timeout = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.include_service_catalog = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.insecure = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.interface = public {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.keyfile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.memcache_password = {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.memcache_username = {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.region_name = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.service_token_roles_required = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.service_type = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.token_cache_time = 300 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.212/identity {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.backend = dogpile.cache.null {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.backend_argument = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.backend_expiration_time = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.config_prefix = cache.oslo {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.debug_cache_backend = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.enable_retry_client = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.enable_socket_keepalive = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.enabled = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.expiration_time = 600 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.hashclient_retry_attempts = 2 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.memcache_dead_retry = 300 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.memcache_pool_maxsize = 10 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.memcache_sasl_enabled = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.password = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.proxies = [] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.redis_db = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.redis_sentinel_service_name = mymaster {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.redis_server = localhost:6379 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.retry_attempts = 2 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.retry_delay = 0.0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.socket_keepalive_count = 1 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.socket_keepalive_idle = 1 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.socket_keepalive_interval = 1 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.socket_timeout = 1.0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.tls_allowed_ciphers = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.tls_cafile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.tls_certfile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.tls_enabled = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.tls_keyfile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cache.username = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] coordination.backend_url = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.asyncio_connection = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.asyncio_slave_connection = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.backend = sqlalchemy {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.connection = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.connection_debug = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.connection_parameters = {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.connection_recycle_time = 3600 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.connection_trace = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.db_inc_retry_interval = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.db_max_retries = 20 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.db_max_retry_interval = 10 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.db_retry_interval = 1 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.max_overflow = 50 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.max_pool_size = 5 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.max_retries = 10 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.mysql_wsrep_sync_wait = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.pool_timeout = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.retry_interval = 10 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.slave_connection = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.sqlite_synchronous = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.synchronous_reader = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] database.use_db_reconnect = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] profiler.connection_string = messaging:// {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] profiler.enabled = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] profiler.es_doc_type = notification {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] profiler.es_scroll_size = 10000 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] profiler.es_scroll_time = 2m {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] profiler.filter_error_trace = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] profiler.hmac_keys = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] profiler.sentinel_service_name = mymaster {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] profiler.socket_timeout = 0.1 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] profiler.trace_requests = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] profiler.trace_sqlalchemy = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] profiler_jaeger.process_tags = {} {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] profiler_jaeger.service_name_prefix = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] profiler_otlp.service_name_prefix = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_policy.enforce_new_defaults = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_policy.enforce_scope = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_policy.policy_default_rule = default {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_policy.policy_file = policy.yaml {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:26 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_policy.remote_timeout = 60.0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] privsep_osbrick.group = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] privsep_osbrick.helper_command = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] privsep_osbrick.user = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cinder_sys_admin.group = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cinder_sys_admin.helper_command = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] cinder_sys_admin.user = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] service_user.auth_section = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] service_user.auth_type = password {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] service_user.cafile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] service_user.certfile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] service_user.collect_timing = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] service_user.insecure = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] service_user.keyfile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] service_user.send_service_user_token = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] service_user.split_loggers = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] service_user.timeout = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance.auth_section = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance.auth_type = password {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance.certfile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance.collect_timing = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance.insecure = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance.keyfile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance.region_name = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance.split_loggers = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] glance.timeout = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.backend_availability_zone = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.chap_password = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.chap_username = {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.disk_geometry = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.driver_client_cert = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.driver_client_cert_key = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.driver_data_namespace = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.driver_use_ssl = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.enable_unsupported_driver = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.extra_capabilities = {} {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.filter_function = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.goodness_function = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.iscsi_target_flags = {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.iscsi_write_cache = on {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.iser_helper = tgtadm {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.iser_ip_address = 192.168.122.212 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.iser_port = 3260 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.nas_host = {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.nas_login = admin {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.nas_mount_options = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.nas_password = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.nas_private_key = {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.nas_share_path = {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.nas_ssh_port = 22 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.num_shell_tries = 3 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.nvmet_port_id = 1 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.quobyte_client_cfg = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.quobyte_volume_url = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.replication_device = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.report_discard_supported = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.reserved_percentage = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.scst_target_driver = iscsi {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.scst_target_iqn_name = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.storage_protocol = iSCSI {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.target_helper = tgtadm {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.target_ip_address = 192.168.122.212 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.target_port = 3260 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.target_protocol = iscsi {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.trace_flags = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.unique_fqdn_network = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.use_chap_auth = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.volume_backend_name = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.volume_clear = zero {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.volume_clear_ionice = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.volume_clear_size = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_reports.file_event_handler = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_reports.log_dir = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.backend_availability_zone = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.backend_host = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.chap_password = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.chap_username = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.chiscsi_conf = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.disk_geometry = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.driver_client_cert = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.driver_client_cert_key = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.driver_data_namespace = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.driver_use_ssl = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.extra_capabilities = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.filter_function = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.goodness_function = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.iscsi_target_flags = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.iscsi_write_cache = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.iser_helper = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.iser_ip_address = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.iser_port = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.iser_target_prefix = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.nas_host = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.nas_login = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.nas_mount_options = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.nas_password = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.nas_private_key = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.nas_share_path = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.nas_ssh_port = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.num_shell_tries = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.nvmet_ns_id = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.nvmet_port_id = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.replication_device = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.report_discard_supported = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.reserved_percentage = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.scst_target_driver = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.storage_protocol = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.target_helper = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.target_ip_address = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.target_port = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.target_prefix = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.target_protocol = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.trace_flags = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.unique_fqdn_network = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.use_chap_auth = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.volume_clear = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.volume_clear_ionice = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.volume_clear_size = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] QuobyteHD.volumes_dir = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.ssl = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86801) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.ssl_version = {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_notifications.driver = [] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_notifications.retry = -1 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] oslo_messaging_notifications.transport_url = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] key_manager.fixed_key = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.quobyte [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 13 20:27:27 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.quobyte [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 13 20:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Running cmd (subprocess): mount.quobyte {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican.barbican_api_version = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican.barbican_endpoint = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican.barbican_endpoint_type = public {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican.barbican_region_name = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican.cafile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican.certfile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican.collect_timing = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican.insecure = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican.keyfile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican.number_of_retries = 60 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican.retry_delay = 1 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican.send_service_user_token = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican.split_loggers = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican.timeout = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican.verify_ssl = True {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican.verify_ssl_path = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican_service_user.auth_section = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican_service_user.auth_type = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican_service_user.cafile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican_service_user.certfile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican_service_user.collect_timing = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican_service_user.insecure = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican_service_user.keyfile = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican_service_user.split_loggers = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] barbican_service_user.timeout = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] vault.approle_role_id = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] vault.approle_secret_id = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] vault.auth_method = approle {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] vault.auth_path = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] vault.kv_mountpoint = secret {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] vault.kv_path = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] vault.kv_version = 2 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] vault.namespace = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] vault.root_token_id = **** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] vault.ssl_ca_crt_file = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] vault.timeout = 60.0 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] vault.token_file = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] vault.token_role = None {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] vault.use_ssl = False {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:27 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] ******************************************************************************** {{(pid=86546) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 13 20:27:27 devstack quobyte-client[86809]: Reading configuration file: /etc/quobyte/client.cfg Jul 13 20:27:27 devstack quobyte-client[86809]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 13 20:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] CMD "mount.quobyte" returned: 1 in 0.097s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:27:27 devstack cinder-volume[86801]: INFO cinder.volume.drivers.quobyte [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 ... Jul 13 20:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 -c /etc/quobyte/client-cinder.cfg {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:27:27 devstack sudo[86810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 -c /etc/quobyte/client-cinder.cfg Jul 13 20:27:27 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:27:27 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root Jul 13 20:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.384s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:27:27 devstack cinder-volume[86801]: INFO cinder.volume.drivers.quobyte [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 succeeded Jul 13 20:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.403s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:27:27 devstack sudo[86885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:27:27 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:27:27 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root Jul 13 20:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.239s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:27:27 devstack cinder-volume[86801]: INFO cinder.volume.driver [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Driver hasn't implemented _init_vendor_properties() Jul 13 20:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.driver [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86801) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 13 20:27:27 devstack cinder-volume[86801]: DEBUG oslo_db.sqlalchemy.engines [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86801) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 20:27:27 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writer thread running {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 13 20:27:27 devstack cinder-volume[86801]: DEBUG cinder.db.api [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Building query based on filter {{(pid=86801) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 13 20:27:27 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86801) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 13 20:27:28 devstack cinder-volume[86801]: INFO cinder.keymgr.migration [None req-6b161b72-a812-47f5-aa08-44a0c50607af None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 13 20:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:27:28 devstack sudo[86906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:27:28 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:27:28 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root Jul 13 20:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.464s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:27:28 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:27:28 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Driver initialization completed successfully. Jul 13 20:27:28 devstack cinder-volume[86801]: INFO cinder.manager [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Initiating service 3 cleanup Jul 13 20:27:28 devstack cinder-volume[86801]: INFO cinder.manager [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Service 3 cleanup completed. Jul 13 20:27:28 devstack cinder-volume[86801]: DEBUG cinder.service [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Creating RPC server for service cinder-volume {{(pid=86801) start /opt/stack/cinder/cinder/service.py:231}} Jul 13 20:27:28 devstack cinder-volume[86801]: DEBUG cinder.service [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86801) start /opt/stack/cinder/cinder/service.py:237}} Jul 13 20:27:28 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 13 20:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:27:28 devstack sudo[86926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:27:28 devstack sudo[86926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:27:29 devstack sudo[86926]: pam_unix(sudo:session): session closed for user root Jul 13 20:27:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.336s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:27:29 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-f4f78c6c-4fa5-49c0-b420-852b0e2a378f None None] Driver post RPC initialization completed successfully. Jul 13 20:27:31 devstack cinder-volume[86546]: INFO oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Caught SIGTERM, stopping children Jul 13 20:27:31 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Acquiring lock "singleton_lock" {{(pid=86546) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 13 20:27:31 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Acquired lock "singleton_lock" {{(pid=86546) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 13 20:27:31 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Releasing lock "singleton_lock" {{(pid=86546) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 13 20:27:31 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Stop services. {{(pid=86546) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 13 20:27:31 devstack cinder-volume[86546]: DEBUG oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Killing children. {{(pid=86546) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 13 20:27:31 devstack cinder-volume[86546]: INFO oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Waiting on 1 children to exit Jul 13 20:27:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Acquiring lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 13 20:27:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Acquired lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 13 20:27:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Releasing lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 13 20:27:32 devstack cinder-volume[86801]: WARNING amqp [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 13 20:27:32 devstack cinder-volume[86801]: WARNING amqp [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 13 20:27:32 devstack cinder-volume[86546]: INFO oslo_service.backend._eventlet.service [None req-d83ef0e9-20c4-4ca8-86e8-0ae072824ebc None None] Child 86801 exited with status 0 Jul 13 20:27:33 devstack cinder-volume[87180]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 13 20:27:33 devstack cinder-volume[87180]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 13 20:27:33 devstack cinder-volume[87180]: we strongly recommend against using it for new projects. Jul 13 20:27:33 devstack cinder-volume[87180]: If you are already using Eventlet, we recommend migrating to a different Jul 13 20:27:33 devstack cinder-volume[87180]: framework. For more detail see Jul 13 20:27:33 devstack cinder-volume[87180]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 13 20:27:33 devstack cinder-volume[87180]: import eventlet # noqa Jul 13 20:27:35 devstack cinder-volume[87180]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87180) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 13 20:27:35 devstack cinder-volume[87180]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87180) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 13 20:27:35 devstack cinder-volume[87180]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87180) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 13 20:27:36 devstack cinder-volume[87180]: INFO dbcounter [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] Registered counter for database cinder Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_db.sqlalchemy.engines [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87180) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG dbcounter [-] [87180] Writer thread running {{(pid=87180) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 13 20:27:36 devstack cinder-volume[87180]: INFO cinder.rpc [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 13 20:27:36 devstack cinder-volume[87180]: INFO cinder.rpc [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_db.sqlalchemy.engines [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87180) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 20:27:36 devstack cinder-volume[87180]: INFO cinder.volume.manager [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] Determined volume DB was empty at startup. Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG cinder.volume.manager [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87180) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 13 20:27:36 devstack cinder-volume[87180]: WARNING stevedore.named [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 13 20:27:36 devstack cinder-volume[87180]: WARNING castellan.key_manager [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 13 20:27:36 devstack cinder-volume[87180]: WARNING cinder.keymgr.conf_key_mgr [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 13 20:27:36 devstack cinder-volume[87180]: INFO cinder.volume.manager [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_db.sqlalchemy.engines [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87180) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 20:27:36 devstack cinder-volume[87180]: INFO oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] Starting 1 workers Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] Started child 87269 {{(pid=87180) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] Full set of CONF: {{(pid=87180) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] ******************************************************************************** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] Configuration options gathered from: {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] ================================================================================ {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] allow_availability_zone_fallback = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] allow_compression_on_image_upload = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] allowed_direct_url_schemes = [] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] api_rate_limit = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] auth_strategy = keystone {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_availability_zone = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_host = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_name = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_stats_polling_interval = 60 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backup_api_class = cinder.backup.api.API {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87269]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backup_name_template = backup-%s {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backup_use_same_host = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backup_use_temp_snapshot = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] chap_password = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] chap_username = {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cinder_internal_tenant_project_id = ab6b2d5063084846964a49a4d7d0d496 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cinder_internal_tenant_user_id = 9966e23979494d5bb3808cae4b4a97fa {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cluster = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] compression_format = gzip {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] compute_api_class = cinder.compute.nova.API {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] config_dir = [] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] config_source = [] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] control_exchange = openstack {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] debug = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] default_availability_zone = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] default_group_type = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] default_volume_type = QuobyteHD {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] disk_geometry = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] driver_client_cert = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] driver_client_cert_key = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] driver_data_namespace = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] driver_ssl_cert_path = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] driver_ssl_cert_verify = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] driver_use_ssl = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] enable_new_services = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] enable_unsupported_driver = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] enabled_backends = ['QuobyteHD'] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] enforce_multipath_for_image_xfer = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] filter_function = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance_api_insecure = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance_api_servers = ['http://192.168.122.212/image'] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance_api_ssl_compression = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance_ca_certificates_file = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance_catalog_info = image:glance:publicURL {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance_certfile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance_keyfile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance_num_retries = 3 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance_request_timeout = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] goodness_function = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] graceful_shutdown_timeout = 5 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] group_api_class = cinder.group.api.API {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] host = devstack {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] image_compress_on_upload = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] image_conversion_address_space_limit = 1 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] image_conversion_cpu_limit = 60 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] image_conversion_disable = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] image_upload_use_cinder_backend = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] image_upload_use_internal_tenant = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] image_volume_cache_enabled = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] image_volume_cache_max_count = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] image_volume_cache_max_size_gb = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] init_host_max_objects_retrieval = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] instance_format = [instance: %(uuid)s] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] iscsi_target_flags = {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] iscsi_write_cache = on {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] iser_helper = tgtadm {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] iser_ip_address = 192.168.122.212 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] iser_port = 3260 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] log_color = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] log_config_append = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] log_dir = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] log_file = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] log_options = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] log_rotate_interval = 1 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] log_rotate_interval_type = days {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] log_rotation_type = none {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] max_age = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] max_logfile_count = 30 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] max_logfile_size_mb = 200 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] max_over_subscription_ratio = 20.0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] message_reap_interval = 86400 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] message_ttl = 2592000 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] migration_create_volume_timeout_secs = 300 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] monkey_patch = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] monkey_patch_modules = [] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] my_ip = 192.168.122.212 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] no_snapshot_gb_quota = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] num_iser_scan_tries = 3 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] num_shell_tries = 3 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] num_volume_device_scan_tries = 3 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] nvmeof_conn_info_version = 1 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] nvmet_ns_id = 10 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] nvmet_port_id = 1 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] osapi_max_limit = 1000 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] osapi_volume_ext_list = [] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] osapi_volume_listen_port = 8776 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] osapi_volume_use_ssl = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] osapi_volume_workers = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] per_volume_size_limit = -1 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] periodic_fuzzy_delay = 60 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] periodic_interval = 60 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] public_endpoint = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] publish_errors = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] quota_backup_gigabytes = 1000 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] quota_backups = 10 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] quota_gigabytes = 1000 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] quota_groups = 10 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] quota_snapshots = 10 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87269) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] quota_volumes = 10 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] rate_limit_burst = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] rate_limit_except_level = CRITICAL {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] rate_limit_interval = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] reinit_driver_count = 3 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] replication_device = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] report_discard_supported = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] report_interval = 120 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] reservation_clean_interval = 86400 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] reservation_expire = 86400 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] reserved_image_namespaces = [] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] reserved_percentage = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] rpc_response_timeout = 120 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] run_external_periodic_tasks = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] scst_target_driver = iscsi {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] scst_target_iqn_name = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] service_down_time = 720 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] shell_completion = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] snapshot_name_template = snapshot-%s {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] split_loggers = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] state_path = /opt/stack/data/cinder {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] storage_availability_zone = nova {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] storage_protocol = iSCSI {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] syslog_log_facility = LOG_USER {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] target_helper = lioadm {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] target_ip_address = 192.168.122.212 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] target_port = 3260 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] target_protocol = iscsi {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] target_secondary_ip_addresses = [] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] trace_flags = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] transport_url = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] until_refresh = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] use_chap_auth = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] use_default_quota_class = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] use_journal = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] use_json = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] use_multipath_for_image_xfer = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] use_stderr = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] use_syslog = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] verify_glance_signatures = enabled {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] volume_api_class = cinder.volume.api.API {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] volume_backend_name = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] volume_clear = zero {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] volume_clear_ionice = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] volume_clear_size = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] volume_copy_bps_limit = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] volume_dd_blocksize = 1M {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] volume_name_template = volume-%s {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] volume_service_inithost_offload = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] volume_usage_audit_period = month {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] zoning_mode = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_concurrency.disable_process_locking = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.auth_section = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.auth_type = password {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.auth_version = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.cache = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.certfile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.include_service_catalog = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.insecure = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.interface = public {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.keyfile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.memcache_password = {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.memcache_username = {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.region_name = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.service_type = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.212/identity {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.backend = dogpile.cache.null {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.backend_argument = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.backend_expiration_time = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.config_prefix = cache.oslo {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.debug_cache_backend = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.enable_retry_client = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.enable_socket_keepalive = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.enabled = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.expiration_time = 600 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.hashclient_retry_attempts = 2 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.memcache_dead_retry = 300 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.memcache_pool_maxsize = 10 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.memcache_sasl_enabled = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.password = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.proxies = [] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.redis_db = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.redis_server = localhost:6379 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.retry_attempts = 2 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.retry_delay = 0.0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.socket_keepalive_count = 1 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.socket_keepalive_idle = 1 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.socket_keepalive_interval = 1 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.socket_timeout = 1.0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.tls_allowed_ciphers = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.tls_cafile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.tls_certfile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.tls_enabled = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.tls_keyfile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cache.username = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] coordination.backend_url = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.asyncio_connection = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.asyncio_slave_connection = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.backend = sqlalchemy {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.connection = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.connection_debug = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.connection_parameters = {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.connection_recycle_time = 3600 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.connection_trace = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.db_inc_retry_interval = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.db_max_retries = 20 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.db_max_retry_interval = 10 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.db_retry_interval = 1 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.max_overflow = 50 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.max_pool_size = 5 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.max_retries = 10 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.mysql_wsrep_sync_wait = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.pool_timeout = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.retry_interval = 10 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.slave_connection = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.sqlite_synchronous = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.synchronous_reader = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] database.use_db_reconnect = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] profiler.connection_string = messaging:// {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] profiler.enabled = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] profiler.es_doc_type = notification {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] profiler.es_scroll_size = 10000 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] profiler.es_scroll_time = 2m {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] profiler.filter_error_trace = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] profiler.hmac_keys = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] profiler.sentinel_service_name = mymaster {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] profiler.socket_timeout = 0.1 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] profiler.trace_requests = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] profiler.trace_sqlalchemy = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] profiler_jaeger.process_tags = {} {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] profiler_jaeger.service_name_prefix = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] profiler_otlp.service_name_prefix = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_policy.enforce_new_defaults = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_policy.enforce_scope = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_policy.policy_default_rule = default {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_policy.policy_file = policy.yaml {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87269) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 13 20:27:36 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.quobyte [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 13 20:27:36 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.quobyte [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] privsep_osbrick.group = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] privsep_osbrick.helper_command = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Running cmd (subprocess): mount.quobyte {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] privsep_osbrick.user = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cinder_sys_admin.group = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cinder_sys_admin.helper_command = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] cinder_sys_admin.user = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] service_user.auth_section = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] service_user.auth_type = password {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] service_user.cafile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] service_user.certfile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] service_user.collect_timing = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] service_user.insecure = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] service_user.keyfile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] service_user.send_service_user_token = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] service_user.split_loggers = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] service_user.timeout = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance.auth_section = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance.auth_type = password {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance.certfile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance.collect_timing = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance.insecure = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance.keyfile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance.region_name = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance.split_loggers = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] glance.timeout = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.backend_availability_zone = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.chap_password = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.chap_username = {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.disk_geometry = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.driver_client_cert = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.driver_client_cert_key = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.driver_data_namespace = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.driver_use_ssl = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.extra_capabilities = {} {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.filter_function = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.goodness_function = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.iscsi_target_flags = {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.iscsi_write_cache = on {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.iser_helper = tgtadm {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.iser_ip_address = 192.168.122.212 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.iser_port = 3260 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.nas_host = {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.nas_login = admin {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.nas_mount_options = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.nas_password = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.nas_private_key = {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.nas_share_path = {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.num_shell_tries = 3 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.quobyte_volume_url = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.replication_device = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.report_discard_supported = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.reserved_percentage = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.target_helper = tgtadm {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.target_ip_address = 192.168.122.212 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.target_port = 3260 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.target_protocol = iscsi {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.trace_flags = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.unique_fqdn_network = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.use_chap_auth = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.volume_backend_name = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.volume_clear = zero {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.volume_clear_ionice = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.volume_clear_size = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_reports.file_event_handler = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_reports.log_dir = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.backend_availability_zone = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.backend_host = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.chap_password = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.chap_username = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.chiscsi_conf = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.disk_geometry = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.driver_client_cert = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.driver_data_namespace = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.driver_use_ssl = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.extra_capabilities = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.filter_function = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.goodness_function = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.iser_helper = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.iser_ip_address = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.iser_port = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.iser_target_prefix = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.nas_host = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.nas_login = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.nas_mount_options = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.nas_password = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.nas_private_key = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.nas_share_path = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.nas_ssh_port = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.num_shell_tries = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.nvmet_port_id = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.replication_device = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.report_discard_supported = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.reserved_percentage = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.scst_target_driver = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.storage_protocol = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack quobyte-client[87270]: Reading configuration file: /etc/quobyte/client.cfg Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.target_helper = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.target_ip_address = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack quobyte-client[87270]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.target_port = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.target_prefix = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.target_protocol = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.trace_flags = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.use_chap_auth = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] CMD "mount.quobyte" returned: 1 in 0.060s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.volume_clear = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.volume_clear_size = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] QuobyteHD.volumes_dir = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.ssl = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_notifications.driver = [] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_notifications.retry = -1 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] key_manager.fixed_key = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican.barbican_api_version = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican.barbican_endpoint = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican.barbican_endpoint_type = public {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican.barbican_region_name = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican.cafile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican.certfile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican.collect_timing = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican.insecure = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican.keyfile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican.number_of_retries = 60 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican.retry_delay = 1 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican.send_service_user_token = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican.split_loggers = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican.timeout = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican.verify_ssl = True {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican.verify_ssl_path = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican_service_user.auth_section = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican_service_user.auth_type = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican_service_user.cafile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican_service_user.certfile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican_service_user.collect_timing = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican_service_user.insecure = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican_service_user.keyfile = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican_service_user.split_loggers = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] barbican_service_user.timeout = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] vault.approle_role_id = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] vault.approle_secret_id = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] vault.auth_method = approle {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] vault.auth_path = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] vault.kv_mountpoint = secret {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] vault.kv_path = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] vault.kv_version = 2 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] vault.namespace = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] vault.root_token_id = **** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] vault.ssl_ca_crt_file = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] vault.timeout = 60.0 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] vault.token_file = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] vault.token_role = None {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] vault.use_ssl = False {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 20:27:36 devstack cinder-volume[87180]: DEBUG oslo_service.backend._eventlet.service [None req-95e64b7b-8405-40ff-9c52-0b8f7741f6b7 None None] ******************************************************************************** {{(pid=87180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 13 20:27:36 devstack sudo[87271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:27:36 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:27:37 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.230s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:27:37 devstack cinder-volume[87269]: INFO cinder.volume.driver [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Driver hasn't implemented _init_vendor_properties() Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG cinder.volume.driver [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87269) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG oslo_db.sqlalchemy.engines [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87269) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writer thread running {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG cinder.db.api [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Building query based on filter {{(pid=87269) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87269) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:27:37 devstack cinder-volume[87269]: INFO cinder.keymgr.migration [None req-5c8319bb-6cee-412d-a47f-13c869fc96c4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 13 20:27:37 devstack sudo[87283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:27:37 devstack sudo[87283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:27:37 devstack sudo[87283]: pam_unix(sudo:session): session closed for user root Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.224s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:27:37 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Driver initialization completed successfully. Jul 13 20:27:37 devstack cinder-volume[87269]: INFO cinder.manager [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Initiating service 3 cleanup Jul 13 20:27:37 devstack cinder-volume[87269]: INFO cinder.manager [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Service 3 cleanup completed. Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG cinder.service [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Creating RPC server for service cinder-volume {{(pid=87269) start /opt/stack/cinder/cinder/service.py:231}} Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG cinder.service [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87269) start /opt/stack/cinder/cinder/service.py:237}} Jul 13 20:27:37 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:27:37 devstack sudo[87294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:27:37 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:27:37 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root Jul 13 20:27:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.225s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:27:37 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-94708b5b-6246-4d4e-a256-6172ed010f41 None None] Driver post RPC initialization completed successfully. Jul 13 20:27:46 devstack cinder-volume[87180]: DEBUG dbcounter [-] [87180] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87180) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:27:47 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=2 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:27:47 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:28:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:28:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 6 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:28:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:29:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:29:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:29:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:29:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:29:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:29:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:29:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:29:18 devstack sudo[87747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:29:18 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:29:19 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root Jul 13 20:29:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.281s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:29:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:29:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:29:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 6 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:29:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:29:47 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:29:47 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:30:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:30:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:30:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:30:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:30:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:30:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:30:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:18 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:30:18 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:19 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.678s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Flow 'volume_create_manager' (fa305e76-691b-4730-bcf0-cbb822c1f830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7ebeeb-1896-4910-bd95-244df57a4bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7ebeeb-1896-4910-bd95-244df57a4bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1377662379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8d6df0-9c2c-4079-ba2c-f83961d83051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89262336824f423eb9857992e20bafba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:30:23Z,use_quota=True,user_id='517796c8bb8c4af68e63888f47e8ade2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60919b3a-e6a4-4bd8-9703-940f67d992a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60919b3a-e6a4-4bd8-9703-940f67d992a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7935ded-9481-407e-a831-f6377417acdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7935ded-9481-407e-a831-f6377417acdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a8d6df0-9c2c-4079-ba2c-f83961d83051', 'volume_name': 'volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c437cbc6-bff6-4d41-818b-98be8a2c9910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c437cbc6-bff6-4d41-818b-98be8a2c9910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8133ca30-1474-4521-a744-c36fba2f11af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:23 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Volume 2a8d6df0-9c2c-4079-ba2c-f83961d83051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051', 'volume_size': 1} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1377662379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8d6df0-9c2c-4079-ba2c-f83961d83051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89262336824f423eb9857992e20bafba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:30:23Z,use_quota=True,user_id='517796c8bb8c4af68e63888f47e8ade2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Creating volume 2a8d6df0-9c2c-4079-ba2c-f83961d83051 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:30:23 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:30:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:23 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051 1073741824 Jul 13 20:30:23 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:24 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051 1073741824" returned: 0 in 1.194s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:24 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051 Jul 13 20:30:24 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:25 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051" returned: 0 in 0.676s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:30:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:30:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8133ca30-1474-4521-a744-c36fba2f11af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef504c0b-db8a-4095-981b-9912bceaa00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:25 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Volume volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051 (2a8d6df0-9c2c-4079-ba2c-f83961d83051): created successfully Jul 13 20:30:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef504c0b-db8a-4095-981b-9912bceaa00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Flow 'volume_create_manager' (fa305e76-691b-4730-bcf0-cbb822c1f830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:30:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b1088319-18e3-4d9a-b85d-3b27ebeccb34 tempest-DeleteServersTestJSON-75958861 None] Created volume successfully. Jul 13 20:30:32 devstack cinder-volume[87269]: WARNING py.warnings [req-b6f01385-13ed-46c8-8eb2-a5aef1b2d341 req-84a8670d-1fc2-4a17-8d58-28bf5be1f83d tempest-DeleteServersTestJSON-75958861 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 13 20:30:32 devstack cinder-volume[87269]: .first() Jul 13 20:30:32 devstack cinder-volume[87269]: Jul 13 20:30:32 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:30:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Flow 'volume_create_manager' (1fc8c035-7f23-4493-b2f0-55c3afd79e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:30:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee77abd1-ca99-4814-8364-58dfca34efd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-b6f01385-13ed-46c8-8eb2-a5aef1b2d341 req-84a8670d-1fc2-4a17-8d58-28bf5be1f83d tempest-DeleteServersTestJSON-75958861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:30:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-b6f01385-13ed-46c8-8eb2-a5aef1b2d341 req-84a8670d-1fc2-4a17-8d58-28bf5be1f83d tempest-DeleteServersTestJSON-75958861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:30:32 devstack cinder-volume[87269]: INFO oslo.privsep.daemon [req-b6f01385-13ed-46c8-8eb2-a5aef1b2d341 req-84a8670d-1fc2-4a17-8d58-28bf5be1f83d tempest-DeleteServersTestJSON-75958861 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpq0pq1lk0/privsep.sock'] Jul 13 20:30:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee77abd1-ca99-4814-8364-58dfca34efd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1874295550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b861a75f-59f7-47ea-aaa0-e3807923c214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8aeb445af94cb79c702c9b0a0dd755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:30:32Z,use_quota=True,user_id='ea55be5079b44f60a89cca7ef454e884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba22439c-fbab-40cc-83ba-cbeb1ea6c86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:32 devstack sudo[88704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpq0pq1lk0/privsep.sock Jul 13 20:30:32 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba22439c-fbab-40cc-83ba-cbeb1ea6c86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b36307-e66f-4450-873c-c9430d77ea0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b36307-e66f-4450-873c-c9430d77ea0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b861a75f-59f7-47ea-aaa0-e3807923c214', 'volume_name': 'volume-b861a75f-59f7-47ea-aaa0-e3807923c214', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c8fa7d-01fe-4449-8f3d-9d2adc49d7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c8fa7d-01fe-4449-8f3d-9d2adc49d7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a04416-626a-41d9-a6d6-764a47652176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:32 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Volume b861a75f-59f7-47ea-aaa0-e3807923c214: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b861a75f-59f7-47ea-aaa0-e3807923c214', 'volume_size': 1} Jul 13 20:30:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:30:33 devstack cinder-volume[87269]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 13 20:30:33 devstack cinder-volume[87269]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 13 20:30:33 devstack cinder-volume[87269]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 13 20:30:33 devstack cinder-volume[87269]: WARNING oslo.privsep.daemon [-] privsep log: Jul 13 20:30:33 devstack cinder-volume[87269]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 13 20:30:33 devstack cinder-volume[87269]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 13 20:30:33 devstack cinder-volume[87269]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 13 20:30:33 devstack cinder-volume[87269]: WARNING oslo.privsep.daemon [-] privsep log: Jul 13 20:30:33 devstack cinder-volume[87269]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 13 20:30:33 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:33 devstack cinder-volume[87269]: INFO oslo.privsep.daemon [req-b6f01385-13ed-46c8-8eb2-a5aef1b2d341 req-84a8670d-1fc2-4a17-8d58-28bf5be1f83d tempest-DeleteServersTestJSON-75958861 None] Spawned new privsep daemon via rootwrap Jul 13 20:30:33 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [req-b6f01385-13ed-46c8-8eb2-a5aef1b2d341 req-84a8670d-1fc2-4a17-8d58-28bf5be1f83d tempest-DeleteServersTestJSON-75958861 None] Accepted privsep connection to /tmp/tmpq0pq1lk0/privsep.sock {{(pid=87269) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 13 20:30:33 devstack cinder-volume[87269]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 13 20:30:33 devstack cinder-volume[87269]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 13 20:30:33 devstack cinder-volume[87269]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 13 20:30:33 devstack cinder-volume[87269]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88710 Jul 13 20:30:33 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb47ed43-e669-4a6b-b5bb-6e771f940526]: (2,) {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:30:33 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a0e0b0-583c-49da-b6f1-6261faeac9a7]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:30:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-b6f01385-13ed-46c8-8eb2-a5aef1b2d341 req-84a8670d-1fc2-4a17-8d58-28bf5be1f83d tempest-DeleteServersTestJSON-75958861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:33 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051 Jul 13 20:30:33 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:34 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-b6f01385-13ed-46c8-8eb2-a5aef1b2d341 req-84a8670d-1fc2-4a17-8d58-28bf5be1f83d tempest-DeleteServersTestJSON-75958861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051" returned: 0 in 0.529s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-b6f01385-13ed-46c8-8eb2-a5aef1b2d341 req-84a8670d-1fc2-4a17-8d58-28bf5be1f83d tempest-DeleteServersTestJSON-75958861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.840s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:30:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.766s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:30:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1874295550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b861a75f-59f7-47ea-aaa0-e3807923c214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8aeb445af94cb79c702c9b0a0dd755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:30:32Z,use_quota=True,user_id='ea55be5079b44f60a89cca7ef454e884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:30:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Creating volume b861a75f-59f7-47ea-aaa0-e3807923c214 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:30:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:30:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:30:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:30:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:30:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:30:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:30:34 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:30:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b861a75f-59f7-47ea-aaa0-e3807923c214 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:34 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b861a75f-59f7-47ea-aaa0-e3807923c214 1073741824 Jul 13 20:30:34 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-b6f01385-13ed-46c8-8eb2-a5aef1b2d341 req-84a8670d-1fc2-4a17-8d58-28bf5be1f83d tempest-DeleteServersTestJSON-75958861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04d2bb85-204c-432c-8c0f-568346becf8d', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:30:34 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-b6f01385-13ed-46c8-8eb2-a5aef1b2d341 req-84a8670d-1fc2-4a17-8d58-28bf5be1f83d tempest-DeleteServersTestJSON-75958861 None] attachment_update completed successfully. Jul 13 20:30:35 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b861a75f-59f7-47ea-aaa0-e3807923c214 1073741824" returned: 0 in 0.842s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b861a75f-59f7-47ea-aaa0-e3807923c214 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:35 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b861a75f-59f7-47ea-aaa0-e3807923c214 Jul 13 20:30:35 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:35 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b861a75f-59f7-47ea-aaa0-e3807923c214" returned: 0 in 0.431s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:30:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:30:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a04416-626a-41d9-a6d6-764a47652176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b861a75f-59f7-47ea-aaa0-e3807923c214', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f2fca7-052c-4c16-9f3f-e7628433b550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:35 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Volume volume-b861a75f-59f7-47ea-aaa0-e3807923c214 (b861a75f-59f7-47ea-aaa0-e3807923c214): created successfully Jul 13 20:30:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f2fca7-052c-4c16-9f3f-e7628433b550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Flow 'volume_create_manager' (1fc8c035-7f23-4493-b2f0-55c3afd79e16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:30:35 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4162d646-e5fc-414c-a6e6-8c7d12af55d0 tempest-VolumesAdminNegativeTest-1784616870 None] Created volume successfully. Jul 13 20:30:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] Acquiring lock "cinder-b861a75f-59f7-47ea-aaa0-e3807923c214-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:30:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] Lock "cinder-b861a75f-59f7-47ea-aaa0-e3807923c214-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:30:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] Acquiring lock "cinder-quobyte-b861a75f-59f7-47ea-aaa0-e3807923c214" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:30:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] Lock "cinder-quobyte-b861a75f-59f7-47ea-aaa0-e3807923c214" acquired by "delete_volume" :: waited 0.059s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:30:37 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24dc14a-eb38-46b0-85e4-7f5ff4f59948]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:30:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b861a75f-59f7-47ea-aaa0-e3807923c214 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:37 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b861a75f-59f7-47ea-aaa0-e3807923c214 Jul 13 20:30:37 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:38 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b861a75f-59f7-47ea-aaa0-e3807923c214" returned: 0 in 0.999s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b861a75f-59f7-47ea-aaa0-e3807923c214 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:38 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b861a75f-59f7-47ea-aaa0-e3807923c214 Jul 13 20:30:38 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:38 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b861a75f-59f7-47ea-aaa0-e3807923c214" returned: 0 in 0.387s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] Lock "cinder-quobyte-b861a75f-59f7-47ea-aaa0-e3807923c214" released by "delete_volume" :: held 1.470s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:30:38 devstack cinder-volume[87269]: WARNING cinder.quota [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:30:38 devstack cinder-volume[87269]: WARNING cinder.quota [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:30:39 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] Created reservations ['3fd10cfe-1992-46a4-9201-48d69fdb6f33', '5f432f5d-9240-47e9-9daf-24b87faf3f90', '3983459b-58bf-44f9-8d98-318099042021', 'a381e704-9290-4faf-898a-d91db5f93c29'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:30:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:30:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:30:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:30:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:30:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:30:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:39 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:30:39 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:39 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.459s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:39 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:30:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] Deleted volume successfully. Jul 13 20:30:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9655086f-584f-415f-8146-b2f14a61ea2a tempest-VolumesAdminNegativeTest-1784616870 None] Lock "cinder-b861a75f-59f7-47ea-aaa0-e3807923c214-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:30:40 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-e4f4f5ed-c166-4f67-b9e9-15e7a1d5d418 req-1f37f981-5443-4a56-96d8-aec6cdd584aa tempest-DeleteServersTestJSON-75958861 None] Terminate volume connection completed successfully. Jul 13 20:30:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-e4f4f5ed-c166-4f67-b9e9-15e7a1d5d418 req-1f37f981-5443-4a56-96d8-aec6cdd584aa tempest-DeleteServersTestJSON-75958861 None] Deleting attachment 04d2bb85-204c-432c-8c0f-568346becf8d. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:30:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] Acquiring lock "cinder-2a8d6df0-9c2c-4079-ba2c-f83961d83051-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:30:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] Lock "cinder-2a8d6df0-9c2c-4079-ba2c-f83961d83051-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:30:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] Acquiring lock "cinder-quobyte-2a8d6df0-9c2c-4079-ba2c-f83961d83051" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:30:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] Lock "cinder-quobyte-2a8d6df0-9c2c-4079-ba2c-f83961d83051" acquired by "delete_volume" :: waited 0.038s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:30:42 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f381df4a-d2de-4057-bfb7-038dd0673fb6]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:30:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:43 devstack sudo[89263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051 Jul 13 20:30:43 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:43 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051" returned: 0 in 0.441s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:43 devstack sudo[89270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051 Jul 13 20:30:43 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:43 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a8d6df0-9c2c-4079-ba2c-f83961d83051" returned: 0 in 0.306s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] Lock "cinder-quobyte-2a8d6df0-9c2c-4079-ba2c-f83961d83051" released by "delete_volume" :: held 0.815s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Flow 'volume_create_manager' (9d267093-aee8-4473-847a-6008a88ea7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc3c7fa-5567-40d9-b61b-94afbdfc182f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc3c7fa-5567-40d9-b61b-94afbdfc182f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1370052679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141f7022-2215-433e-a993-dfc528d77d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16f7aae5b4194276813065a4586c39da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:30:44Z,use_quota=True,user_id='f443655b8d2a4169970dd47ff7667867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e048f532-8229-4dbb-b024-203be4cf8c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e048f532-8229-4dbb-b024-203be4cf8c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2783f98c-3106-4b0a-b73c-ccba8e75e960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2783f98c-3106-4b0a-b73c-ccba8e75e960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '141f7022-2215-433e-a993-dfc528d77d98', 'volume_name': 'volume-141f7022-2215-433e-a993-dfc528d77d98', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d7cb85-82e8-4c9e-8be4-224c003848f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d7cb85-82e8-4c9e-8be4-224c003848f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3e0f2a-0460-4313-b724-f2bf45594459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:43 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Volume 141f7022-2215-433e-a993-dfc528d77d98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-141f7022-2215-433e-a993-dfc528d77d98', 'volume_size': 1} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1370052679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141f7022-2215-433e-a993-dfc528d77d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16f7aae5b4194276813065a4586c39da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:30:44Z,use_quota=True,user_id='f443655b8d2a4169970dd47ff7667867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Creating volume 141f7022-2215-433e-a993-dfc528d77d98 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:30:43 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-141f7022-2215-433e-a993-dfc528d77d98 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:43 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-141f7022-2215-433e-a993-dfc528d77d98 1073741824 Jul 13 20:30:43 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] Created reservations ['afff38ca-ced4-487b-8347-223562007a2b', '3aea0a86-b46c-46c7-83aa-4b7bc93a4de6', 'f92b2245-21f9-4751-a773-3b571018ddaf', 'ab3a8170-174e-427b-9803-0e63303a55d7'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:30:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:43 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:30:43 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:44 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.430s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:44 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:30:44 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] Deleted volume successfully. Jul 13 20:30:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef8b5368-ceff-4491-b6b0-99951bda41a4 tempest-DeleteServersTestJSON-75958861 None] Lock "cinder-2a8d6df0-9c2c-4079-ba2c-f83961d83051-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:30:44 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-141f7022-2215-433e-a993-dfc528d77d98 1073741824" returned: 0 in 0.646s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-141f7022-2215-433e-a993-dfc528d77d98 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:44 devstack sudo[89281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-141f7022-2215-433e-a993-dfc528d77d98 Jul 13 20:30:44 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:44 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-141f7022-2215-433e-a993-dfc528d77d98" returned: 0 in 0.296s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:30:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:30:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3e0f2a-0460-4313-b724-f2bf45594459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-141f7022-2215-433e-a993-dfc528d77d98', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af1132e-c2c5-4233-8d82-c538ab6fe0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:44 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Volume volume-141f7022-2215-433e-a993-dfc528d77d98 (141f7022-2215-433e-a993-dfc528d77d98): created successfully Jul 13 20:30:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af1132e-c2c5-4233-8d82-c538ab6fe0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Flow 'volume_create_manager' (9d267093-aee8-4473-847a-6008a88ea7a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:30:44 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-817ca065-2ce8-4eb8-bd01-d8c823f7ec66 tempest-ServerActionsTestOtherA-2119233136 None] Created volume successfully. Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Flow 'volume_create_manager' (51b8b2f1-9fe9-443a-acb5-341136e1b921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498d48a5-7fa0-45b9-ba28-cebcfd9cf8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498d48a5-7fa0-45b9-ba28-cebcfd9cf8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-467670565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59cb8191-3153-44c1-8785-5cc577180f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5dd940fd6245c5bf881d23dbd1ede5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:30:55Z,use_quota=True,user_id='7ec52ec6a034470b80b603995347aa46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4050f100-8f18-4e99-a741-d132599693e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4050f100-8f18-4e99-a741-d132599693e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c08ff67-d66c-405b-ade4-61b7d79ead2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c08ff67-d66c-405b-ade4-61b7d79ead2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59cb8191-3153-44c1-8785-5cc577180f77', 'volume_name': 'volume-59cb8191-3153-44c1-8785-5cc577180f77', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48fba4a-73d0-4409-b4c7-71432c292b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48fba4a-73d0-4409-b4c7-71432c292b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72638ca-5d4a-4291-9dff-d5f028898927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:54 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Volume 59cb8191-3153-44c1-8785-5cc577180f77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59cb8191-3153-44c1-8785-5cc577180f77', 'volume_size': 1} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-467670565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59cb8191-3153-44c1-8785-5cc577180f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5dd940fd6245c5bf881d23dbd1ede5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:30:55Z,use_quota=True,user_id='7ec52ec6a034470b80b603995347aa46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Creating volume 59cb8191-3153-44c1-8785-5cc577180f77 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:30:54 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:30:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:54 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77 1073741824 Jul 13 20:30:54 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-71a9e872-9efb-48e0-9dcc-f145e871c6e9 tempest-GroupSnapshotsV319Test-1122386423 None] Group tempest-GroupSnapshotsV319Test-Group-612574408: creating Jul 13 20:30:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-71a9e872-9efb-48e0-9dcc-f145e871c6e9 tempest-GroupSnapshotsV319Test-1122386423 None] Group tempest-GroupSnapshotsV319Test-Group-612574408: created successfully Jul 13 20:30:55 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-71a9e872-9efb-48e0-9dcc-f145e871c6e9 tempest-GroupSnapshotsV319Test-1122386423 None] Create group completed successfully. Jul 13 20:30:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77 1073741824" returned: 0 in 0.674s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:55 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77 Jul 13 20:30:55 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:55 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77" returned: 0 in 0.271s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:30:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:30:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72638ca-5d4a-4291-9dff-d5f028898927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59cb8191-3153-44c1-8785-5cc577180f77', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cea053d-153a-4f28-99bc-dd5620aa0564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:55 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Volume volume-59cb8191-3153-44c1-8785-5cc577180f77 (59cb8191-3153-44c1-8785-5cc577180f77): created successfully Jul 13 20:30:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cea053d-153a-4f28-99bc-dd5620aa0564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Flow 'volume_create_manager' (51b8b2f1-9fe9-443a-acb5-341136e1b921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:30:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-e9c74701-ed32-496d-8090-bd65501adaff req-0ebda55a-2121-4961-a00d-c75f97a38608 tempest-VolumesSnapshotsTestJSON-1860289239 None] Created volume successfully. Jul 13 20:30:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-d5235836-ad3c-4edd-a595-594be053e433 req-03d0cd1b-5249-4d3b-a560-69b56c43b455 tempest-VolumesSnapshotsTestJSON-1860289239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:30:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-d5235836-ad3c-4edd-a595-594be053e433 req-03d0cd1b-5249-4d3b-a560-69b56c43b455 tempest-VolumesSnapshotsTestJSON-1860289239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:30:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [req-d5235836-ad3c-4edd-a595-594be053e433 req-03d0cd1b-5249-4d3b-a560-69b56c43b455 tempest-VolumesSnapshotsTestJSON-1860289239 None] Creating offline snapshot b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97 of volume 59cb8191-3153-44c1-8785-5cc577180f77 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:30:57 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0af937a-596e-4f6b-90f3-2b5591cf5f55]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:30:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d5235836-ad3c-4edd-a595-594be053e433 req-03d0cd1b-5249-4d3b-a560-69b56c43b455 tempest-VolumesSnapshotsTestJSON-1860289239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:57 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:30:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Flow 'volume_create_manager' (43c435c9-8a78-4a90-b21f-4575a1dff473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:30:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a41b61b-f9bc-40ab-b9ce-6b3e2bb2dadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:57 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77 Jul 13 20:30:57 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a41b61b-f9bc-40ab-b9ce-6b3e2bb2dadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-535216311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95985164-22fa-4cbd-aae3-e19050ebad76,host='devstack@QuobyteHD#QuobyteHD',id=32e91a0a-3f26-49c7-8b48-f5852b772eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb73daff9d4453f944e8946ca3e3ba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:30:58Z,use_quota=True,user_id='99592023ba6144de893e2c13ce0ade54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(937c72de-fa82-4f1c-bf3f-cafedb809cac),volume_type_id=937c72de-fa82-4f1c-bf3f-cafedb809cac)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b342393-5ff9-4dc6-81df-8ab97ba0fd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b342393-5ff9-4dc6-81df-8ab97ba0fd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046049a0-7fd7-403f-9e50-f409808440f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046049a0-7fd7-403f-9e50-f409808440f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32e91a0a-3f26-49c7-8b48-f5852b772eff', 'volume_name': 'volume-32e91a0a-3f26-49c7-8b48-f5852b772eff', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21d07fa-07be-43be-9a37-122fcb0faa3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21d07fa-07be-43be-9a37-122fcb0faa3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:30:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3a8f1e-f492-460b-a2bc-91965d1ea045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:30:57 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Volume 32e91a0a-3f26-49c7-8b48-f5852b772eff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32e91a0a-3f26-49c7-8b48-f5852b772eff', 'volume_size': 1} Jul 13 20:30:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:30:58 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d5235836-ad3c-4edd-a595-594be053e433 req-03d0cd1b-5249-4d3b-a560-69b56c43b455 tempest-VolumesSnapshotsTestJSON-1860289239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77" returned: 0 in 0.627s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d5235836-ad3c-4edd-a595-594be053e433 req-03d0cd1b-5249-4d3b-a560-69b56c43b455 tempest-VolumesSnapshotsTestJSON-1860289239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:58 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97 1G Jul 13 20:30:58 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:58 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d5235836-ad3c-4edd-a595-594be053e433 req-03d0cd1b-5249-4d3b-a560-69b56c43b455 tempest-VolumesSnapshotsTestJSON-1860289239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97 1G" returned: 0 in 0.626s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d5235836-ad3c-4edd-a595-594be053e433 req-03d0cd1b-5249-4d3b-a560-69b56c43b455 tempest-VolumesSnapshotsTestJSON-1860289239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59cb8191-3153-44c1-8785-5cc577180f77 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:58 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59cb8191-3153-44c1-8785-5cc577180f77 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97 Jul 13 20:30:58 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:59 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d5235836-ad3c-4edd-a595-594be053e433 req-03d0cd1b-5249-4d3b-a560-69b56c43b455 tempest-VolumesSnapshotsTestJSON-1860289239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59cb8191-3153-44c1-8785-5cc577180f77 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97" returned: 0 in 0.334s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:59 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [req-d5235836-ad3c-4edd-a595-594be053e433 req-03d0cd1b-5249-4d3b-a560-69b56c43b455 tempest-VolumesSnapshotsTestJSON-1860289239 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97 is being set with open permissions: ugo+rw Jul 13 20:30:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d5235836-ad3c-4edd-a595-594be053e433 req-03d0cd1b-5249-4d3b-a560-69b56c43b455 tempest-VolumesSnapshotsTestJSON-1860289239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:59 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97 Jul 13 20:30:59 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:59 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d5235836-ad3c-4edd-a595-594be053e433 req-03d0cd1b-5249-4d3b-a560-69b56c43b455 tempest-VolumesSnapshotsTestJSON-1860289239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97" returned: 0 in 0.381s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d5235836-ad3c-4edd-a595-594be053e433 req-03d0cd1b-5249-4d3b-a560-69b56c43b455 tempest-VolumesSnapshotsTestJSON-1860289239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:59 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.info Jul 13 20:30:59 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:30:59 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Jul 13 20:30:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d5235836-ad3c-4edd-a595-594be053e433 req-03d0cd1b-5249-4d3b-a560-69b56c43b455 tempest-VolumesSnapshotsTestJSON-1860289239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.info" returned: 0 in 0.273s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:30:59 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [req-d5235836-ad3c-4edd-a595-594be053e433 req-03d0cd1b-5249-4d3b-a560-69b56c43b455 tempest-VolumesSnapshotsTestJSON-1860289239 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.info is being set with open permissions: ugo+rw Jul 13 20:30:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d5235836-ad3c-4edd-a595-594be053e433 req-03d0cd1b-5249-4d3b-a560-69b56c43b455 tempest-VolumesSnapshotsTestJSON-1860289239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:30:59 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.info Jul 13 20:30:59 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:00 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d5235836-ad3c-4edd-a595-594be053e433 req-03d0cd1b-5249-4d3b-a560-69b56c43b455 tempest-VolumesSnapshotsTestJSON-1860289239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.info" returned: 0 in 0.431s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-d5235836-ad3c-4edd-a595-594be053e433 req-03d0cd1b-5249-4d3b-a560-69b56c43b455 tempest-VolumesSnapshotsTestJSON-1860289239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.873s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.457s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95985164-22fa-4cbd-aae3-e19050ebad76,created_at=2026-07-13T18:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-535216311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95985164-22fa-4cbd-aae3-e19050ebad76,host='devstack@QuobyteHD#QuobyteHD',id=32e91a0a-3f26-49c7-8b48-f5852b772eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb73daff9d4453f944e8946ca3e3ba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:30:58Z,use_quota=True,user_id='99592023ba6144de893e2c13ce0ade54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(937c72de-fa82-4f1c-bf3f-cafedb809cac),volume_type_id=937c72de-fa82-4f1c-bf3f-cafedb809cac)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Creating volume 32e91a0a-3f26-49c7-8b48-f5852b772eff {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:31:00 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:00 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff 1073741824 Jul 13 20:31:00 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:00 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-d5235836-ad3c-4edd-a595-594be053e433 req-03d0cd1b-5249-4d3b-a560-69b56c43b455 tempest-VolumesSnapshotsTestJSON-1860289239 None] Create snapshot completed successfully Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] Acquiring lock "cinder-b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] Lock "cinder-b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] Acquiring lock "cinder-quobyte-59cb8191-3153-44c1-8785-5cc577180f77" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] Lock "cinder-quobyte-59cb8191-3153-44c1-8785-5cc577180f77" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] Acquiring lock "cinder-quobyte-b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] Lock "cinder-quobyte-b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] Deleting offline snapshot b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97 of volume 59cb8191-3153-44c1-8785-5cc577180f77 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] snapshot_file for this snap is: volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d52a61-f623-4ba4-867f-3796117058f1]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:01 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97 Jul 13 20:31:01 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:01 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff 1073741824" returned: 0 in 0.863s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:01 devstack sudo[89414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff Jul 13 20:31:01 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:01 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff" returned: 0 in 0.353s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:31:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:01 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3a8f1e-f492-460b-a2bc-91965d1ea045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32e91a0a-3f26-49c7-8b48-f5852b772eff', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a9f628-6b49-453f-b250-b46ad9e82bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97" returned: 0 in 0.801s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59cb8191-3153-44c1-8785-5cc577180f77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:31:01 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Volume volume-32e91a0a-3f26-49c7-8b48-f5852b772eff (32e91a0a-3f26-49c7-8b48-f5852b772eff): created successfully Jul 13 20:31:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a9f628-6b49-453f-b250-b46ad9e82bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Flow 'volume_create_manager' (43c435c9-8a78-4a90-b21f-4575a1dff473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:31:01 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafb79f4-0ea7-4afd-9127-a16fb13ae203]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:01 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-92bbfc37-89ae-418a-bead-0ef1b720fd60 tempest-GroupSnapshotsV319Test-1122386423 None] Created volume successfully. Jul 13 20:31:02 devstack sudo[89423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77 Jul 13 20:31:02 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:02 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77" returned: 0 in 0.606s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:02 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97 Jul 13 20:31:02 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:02 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97" returned: 0 in 0.425s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:02 devstack sudo[89435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97 Jul 13 20:31:02 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:03 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77.b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97" returned: 0 in 0.285s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] Lock "cinder-quobyte-b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97" released by "_delete_snapshot" :: held 2.271s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] Lock "cinder-quobyte-59cb8191-3153-44c1-8785-5cc577180f77" released by "delete_snapshot" :: held 2.322s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:03 devstack cinder-volume[87269]: WARNING cinder.quota [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:31:03 devstack cinder-volume[87269]: DEBUG cinder.quota [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] Created reservations ['69003378-c488-4082-bf2a-bd9fb8131a97', 'e871800e-d2a9-4b73-a3ab-35ef5bdaa238', '03584876-f059-48bd-8a4c-7df260651583', '6019f21b-bcc0-4496-90ea-5c3de35c5019'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:31:03 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] Delete snapshot completed successfully. Jul 13 20:31:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-9117b227-d16a-48de-bc93-3c01627f019a req-dd11256f-4617-4c27-858d-5b4f4c092b07 tempest-VolumesSnapshotsTestJSON-1860289239 None] Lock "cinder-b7a43eca-bc78-4cb2-aed7-8d4e7dd09b97-delete_snapshot" released by "delete_snapshot" :: held 2.556s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:03 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] GroupSnapshot 27ad33b4-d6aa-4e45-9b23-1d9381d80d63: creating. Jul 13 20:31:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] Group snapshot 27ad33b4-d6aa-4e45-9b23-1d9381d80d63: creating. {{(pid=87269) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 13 20:31:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] Creating offline snapshot fdcac70e-705a-4d94-aaf1-1aa81119fb92 of volume 32e91a0a-3f26-49c7-8b48-f5852b772eff {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:31:03 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3befb23-52fc-403a-8ab2-e545b2056f43]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:03 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff Jul 13 20:31:03 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:04 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff" returned: 0 in 0.388s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:04 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92 1G Jul 13 20:31:04 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] Acquiring lock "cinder-59cb8191-3153-44c1-8785-5cc577180f77-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] Lock "cinder-59cb8191-3153-44c1-8785-5cc577180f77-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] Acquiring lock "cinder-quobyte-59cb8191-3153-44c1-8785-5cc577180f77" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] Lock "cinder-quobyte-59cb8191-3153-44c1-8785-5cc577180f77" acquired by "delete_volume" :: waited 0.043s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:04 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffa31b5-37dc-4183-b2cf-7bfad3b14e21]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:04 devstack sudo[89445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77 Jul 13 20:31:04 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:04 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92 1G" returned: 0 in 0.641s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32e91a0a-3f26-49c7-8b48-f5852b772eff -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:04 devstack sudo[89451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32e91a0a-3f26-49c7-8b48-f5852b772eff -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92 Jul 13 20:31:04 devstack sudo[89451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:05 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77" returned: 0 in 0.566s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:05 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77 Jul 13 20:31:05 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:05 devstack sudo[89451]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32e91a0a-3f26-49c7-8b48-f5852b772eff -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92" returned: 0 in 0.337s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:05 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92 is being set with open permissions: ugo+rw: NotImplementedError Jul 13 20:31:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:05 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92 Jul 13 20:31:05 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:05 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-59cb8191-3153-44c1-8785-5cc577180f77" returned: 0 in 0.326s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] Lock "cinder-quobyte-59cb8191-3153-44c1-8785-5cc577180f77" released by "delete_volume" :: held 0.999s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:05 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92" returned: 0 in 0.357s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:05 devstack cinder-volume[87269]: DEBUG cinder.quota [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] Created reservations ['76ccf901-5a6a-451e-b586-2e9e30fde231', 'e7a54235-70df-45fd-bca5-fbc6846df979', 'bc52ece7-ffdb-45b9-af1e-c26444dada42', 'fef2bceb-b0fb-4ca3-befb-c1ec7db38a9b'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:31:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:05 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.info Jul 13 20:31:05 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:31:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:31:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:05 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:31:05 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:05 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.info" returned: 0 in 0.329s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:05 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.info is being set with open permissions: ugo+rw: NotImplementedError Jul 13 20:31:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:05 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.info Jul 13 20:31:05 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:05 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.339s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:05 devstack cinder-volume[87269]: DEBUG cinder.manager [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:31:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] Deleted volume successfully. Jul 13 20:31:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-d66554a1-bc9a-4d8a-90c8-6fbe7973d088 req-7ac082b4-b65b-4a94-a9e6-536eccda9c22 tempest-VolumesSnapshotsTestJSON-1860289239 None] Lock "cinder-59cb8191-3153-44c1-8785-5cc577180f77-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:06 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.info" returned: 0 in 0.332s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.525s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3e290765-33be-4363-b4e2-da587c14d069 tempest-GroupSnapshotsV319Test-1122386423 None] group_snapshot 27ad33b4-d6aa-4e45-9b23-1d9381d80d63: created successfully Jul 13 20:31:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] group_snapshot 27ad33b4-d6aa-4e45-9b23-1d9381d80d63: deleting Jul 13 20:31:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] group_snapshot 27ad33b4-d6aa-4e45-9b23-1d9381d80d63: deleting {{(pid=87269) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 13 20:31:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] Acquiring lock "cinder-quobyte-32e91a0a-3f26-49c7-8b48-f5852b772eff" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] Lock "cinder-quobyte-32e91a0a-3f26-49c7-8b48-f5852b772eff" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] Acquiring lock "cinder-quobyte-fdcac70e-705a-4d94-aaf1-1aa81119fb92" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] Lock "cinder-quobyte-fdcac70e-705a-4d94-aaf1-1aa81119fb92" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] Deleting offline snapshot fdcac70e-705a-4d94-aaf1-1aa81119fb92 of volume 32e91a0a-3f26-49c7-8b48-f5852b772eff {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:31:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] snapshot_file for this snap is: volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:31:07 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6357fc0-448b-4ec5-b10d-246e34a758ad]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:08 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92 Jul 13 20:31:08 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:08 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92" returned: 0 in 0.538s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32e91a0a-3f26-49c7-8b48-f5852b772eff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:31:08 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b87545f-7cd0-4979-83df-9971cbe418b8]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:08 devstack sudo[89479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff Jul 13 20:31:08 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:08 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff" returned: 0 in 0.478s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:08 devstack sudo[89485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92 Jul 13 20:31:08 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:09 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92" returned: 0 in 0.440s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:09 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92 Jul 13 20:31:09 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:09 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff.fdcac70e-705a-4d94-aaf1-1aa81119fb92" returned: 0 in 0.291s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] Lock "cinder-quobyte-fdcac70e-705a-4d94-aaf1-1aa81119fb92" released by "_delete_snapshot" :: held 1.933s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] Lock "cinder-quobyte-32e91a0a-3f26-49c7-8b48-f5852b772eff" released by "delete_snapshot" :: held 1.964s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:09 devstack cinder-volume[87269]: WARNING cinder.quota [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1133926567 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1133926567, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:31:09 devstack cinder-volume[87269]: WARNING cinder.quota [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1133926567 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1133926567, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:31:09 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] Created reservations ['5703c3f4-c1ed-4f91-9de5-bfb6df9d7f02', '67deed7c-d1da-4987-a68b-a2a810c7d6c4', '2a574272-3223-4b75-82b4-4e984c265215', '1cd402e7-9176-4dde-aafe-7c76add17a7a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:31:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-55616de0-6483-428b-9662-aead284f7674 tempest-GroupSnapshotsV319Test-1122386423 None] group_snapshot 27ad33b4-d6aa-4e45-9b23-1d9381d80d63: deleted successfully Jul 13 20:31:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-359d4a99-9f9e-4103-b41f-52efd69d631c tempest-GroupSnapshotsV319Test-1122386423 None] Acquiring lock "cinder-quobyte-32e91a0a-3f26-49c7-8b48-f5852b772eff" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-359d4a99-9f9e-4103-b41f-52efd69d631c tempest-GroupSnapshotsV319Test-1122386423 None] Lock "cinder-quobyte-32e91a0a-3f26-49c7-8b48-f5852b772eff" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:10 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be76441-23a3-4221-9b0b-c1f71bb2e7c5]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-359d4a99-9f9e-4103-b41f-52efd69d631c tempest-GroupSnapshotsV319Test-1122386423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:11 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff Jul 13 20:31:11 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:11 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-359d4a99-9f9e-4103-b41f-52efd69d631c tempest-GroupSnapshotsV319Test-1122386423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff" returned: 0 in 0.571s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-359d4a99-9f9e-4103-b41f-52efd69d631c tempest-GroupSnapshotsV319Test-1122386423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:11 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff Jul 13 20:31:11 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:11 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-359d4a99-9f9e-4103-b41f-52efd69d631c tempest-GroupSnapshotsV319Test-1122386423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32e91a0a-3f26-49c7-8b48-f5852b772eff" returned: 0 in 0.281s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-359d4a99-9f9e-4103-b41f-52efd69d631c tempest-GroupSnapshotsV319Test-1122386423 None] Lock "cinder-quobyte-32e91a0a-3f26-49c7-8b48-f5852b772eff" released by "delete_volume" :: held 0.952s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:11 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-359d4a99-9f9e-4103-b41f-52efd69d631c tempest-GroupSnapshotsV319Test-1122386423 None] Created reservations ['f72291df-fc7b-4f88-beb8-5650f35a244c'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:31:11 devstack cinder-volume[87269]: WARNING cinder.quota [None req-359d4a99-9f9e-4103-b41f-52efd69d631c tempest-GroupSnapshotsV319Test-1122386423 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1133926567 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1133926567, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:31:11 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-359d4a99-9f9e-4103-b41f-52efd69d631c tempest-GroupSnapshotsV319Test-1122386423 None] Created reservations ['71f4cec6-62c1-40f6-a31e-86a6e5a030d6', '3e7de204-2bb9-49dd-91ac-651465a8695b', '6fd5df46-53bf-4674-ba5f-5d61fb967fdd', '7d832484-5300-4f9d-85ad-0e3f23927c7c'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:31:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-359d4a99-9f9e-4103-b41f-52efd69d631c tempest-GroupSnapshotsV319Test-1122386423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-359d4a99-9f9e-4103-b41f-52efd69d631c tempest-GroupSnapshotsV319Test-1122386423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-359d4a99-9f9e-4103-b41f-52efd69d631c tempest-GroupSnapshotsV319Test-1122386423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:31:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-359d4a99-9f9e-4103-b41f-52efd69d631c tempest-GroupSnapshotsV319Test-1122386423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:31:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-359d4a99-9f9e-4103-b41f-52efd69d631c tempest-GroupSnapshotsV319Test-1122386423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-359d4a99-9f9e-4103-b41f-52efd69d631c tempest-GroupSnapshotsV319Test-1122386423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:12 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:31:12 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:12 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-359d4a99-9f9e-4103-b41f-52efd69d631c tempest-GroupSnapshotsV319Test-1122386423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.278s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:12 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-359d4a99-9f9e-4103-b41f-52efd69d631c tempest-GroupSnapshotsV319Test-1122386423 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:31:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-359d4a99-9f9e-4103-b41f-52efd69d631c tempest-GroupSnapshotsV319Test-1122386423 None] Delete group completed successfully. Jul 13 20:31:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:31:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:31:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:31:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:18 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:31:18 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:19 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.358s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:31:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:31:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 8 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:31:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:31:19 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=61,cinder:SELECT=66,cinder:INSERT=19,cinder:DELETE=6 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:31:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f39b9c3a-2af1-47d8-b9b2-0c272588b116 tempest-GroupsV320Test-740605238 None] Group tempest-GroupsV320Test-Group-1039264698: creating Jul 13 20:31:19 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=62,cinder:UPDATE=74,cinder:DELETE=3,cinder:INSERT=13 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:31:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f39b9c3a-2af1-47d8-b9b2-0c272588b116 tempest-GroupsV320Test-740605238 None] Group tempest-GroupsV320Test-Group-1039264698: created successfully Jul 13 20:31:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f39b9c3a-2af1-47d8-b9b2-0c272588b116 tempest-GroupsV320Test-740605238 None] Create group completed successfully. Jul 13 20:31:21 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-e763c7bb-4ea5-4479-b1d8-efe8b475e71c tempest-GroupsV320Test-740605238 None] Created reservations ['b657f3c3-0ca6-4e5b-928c-341c4c62b42b'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:31:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e763c7bb-4ea5-4479-b1d8-efe8b475e71c tempest-GroupsV320Test-740605238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e763c7bb-4ea5-4479-b1d8-efe8b475e71c tempest-GroupsV320Test-740605238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e763c7bb-4ea5-4479-b1d8-efe8b475e71c tempest-GroupsV320Test-740605238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:31:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e763c7bb-4ea5-4479-b1d8-efe8b475e71c tempest-GroupsV320Test-740605238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:31:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e763c7bb-4ea5-4479-b1d8-efe8b475e71c tempest-GroupsV320Test-740605238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e763c7bb-4ea5-4479-b1d8-efe8b475e71c tempest-GroupsV320Test-740605238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:21 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:31:21 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:21 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e763c7bb-4ea5-4479-b1d8-efe8b475e71c tempest-GroupsV320Test-740605238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.283s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:21 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-e763c7bb-4ea5-4479-b1d8-efe8b475e71c tempest-GroupsV320Test-740605238 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:31:21 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e763c7bb-4ea5-4479-b1d8-efe8b475e71c tempest-GroupsV320Test-740605238 None] Delete group completed successfully. Jul 13 20:31:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-bf44d87f-c44e-4241-b5bd-ea9fb9f3db7f req-ee7083b5-010e-4ed1-a226-d2dbf1f0ccba tempest-ServerActionsTestOtherA-2119233136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-bf44d87f-c44e-4241-b5bd-ea9fb9f3db7f req-ee7083b5-010e-4ed1-a226-d2dbf1f0ccba tempest-ServerActionsTestOtherA-2119233136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:23 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67365ad-d0ce-4d6d-bc24-7e50de9d881f]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-bf44d87f-c44e-4241-b5bd-ea9fb9f3db7f req-ee7083b5-010e-4ed1-a226-d2dbf1f0ccba tempest-ServerActionsTestOtherA-2119233136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-141f7022-2215-433e-a993-dfc528d77d98 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:23 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-141f7022-2215-433e-a993-dfc528d77d98 Jul 13 20:31:23 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:23 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-bf44d87f-c44e-4241-b5bd-ea9fb9f3db7f req-ee7083b5-010e-4ed1-a226-d2dbf1f0ccba tempest-ServerActionsTestOtherA-2119233136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-141f7022-2215-433e-a993-dfc528d77d98" returned: 0 in 0.498s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-bf44d87f-c44e-4241-b5bd-ea9fb9f3db7f req-ee7083b5-010e-4ed1-a226-d2dbf1f0ccba tempest-ServerActionsTestOtherA-2119233136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.533s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-bf44d87f-c44e-4241-b5bd-ea9fb9f3db7f req-ee7083b5-010e-4ed1-a226-d2dbf1f0ccba tempest-ServerActionsTestOtherA-2119233136 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-141f7022-2215-433e-a993-dfc528d77d98', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a9111cc-73a0-4bfd-abf0-1f5f3c4a6e02', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:31:23 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-bf44d87f-c44e-4241-b5bd-ea9fb9f3db7f req-ee7083b5-010e-4ed1-a226-d2dbf1f0ccba tempest-ServerActionsTestOtherA-2119233136 None] attachment_update completed successfully. Jul 13 20:31:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-b23662ee-84ac-4ec9-b413-4ea5b49b1200 req-86d3a70b-da70-45e1-b7f1-e95be64030a8 tempest-ServerActionsTestOtherA-2119233136 None] Terminate volume connection completed successfully. Jul 13 20:31:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-b23662ee-84ac-4ec9-b413-4ea5b49b1200 req-86d3a70b-da70-45e1-b7f1-e95be64030a8 tempest-ServerActionsTestOtherA-2119233136 None] Deleting attachment 5a9111cc-73a0-4bfd-abf0-1f5f3c4a6e02. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:31:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-b23662ee-84ac-4ec9-b413-4ea5b49b1200 req-1614783f-9c5a-4e3b-b967-1865120f6bdd tempest-ServerActionsTestOtherA-2119233136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-b23662ee-84ac-4ec9-b413-4ea5b49b1200 req-1614783f-9c5a-4e3b-b967-1865120f6bdd tempest-ServerActionsTestOtherA-2119233136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:29 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fae5325-a022-444d-ae66-81eff79f4b8c]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-b23662ee-84ac-4ec9-b413-4ea5b49b1200 req-1614783f-9c5a-4e3b-b967-1865120f6bdd tempest-ServerActionsTestOtherA-2119233136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-141f7022-2215-433e-a993-dfc528d77d98 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:30 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-141f7022-2215-433e-a993-dfc528d77d98 Jul 13 20:31:30 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Flow 'volume_create_manager' (fc477f94-519b-45f3-a26d-09a04c049aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412822b6-bd99-4d3f-a3e0-4dfee206b4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412822b6-bd99-4d3f-a3e0-4dfee206b4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1917003489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b08bee-202a-4867-9e47-5f43f81a05b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a093fb7aefd4f1d8bb054f923e9573a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:31:30Z,use_quota=True,user_id='6f9c3b11dadf4fcf875d62ba1a15a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f8c8c6-951e-4551-a862-3404ea4ef7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f8c8c6-951e-4551-a862-3404ea4ef7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e50eb79-364c-40bb-abb1-a651f34723f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e50eb79-364c-40bb-abb1-a651f34723f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b08bee-202a-4867-9e47-5f43f81a05b4', 'volume_name': 'volume-12b08bee-202a-4867-9e47-5f43f81a05b4', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db407cb-aa43-4d1e-b4b7-66807ee819e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db407cb-aa43-4d1e-b4b7-66807ee819e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3897e721-4770-4069-94cf-5a32e05dae34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:30 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Volume 12b08bee-202a-4867-9e47-5f43f81a05b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b08bee-202a-4867-9e47-5f43f81a05b4', 'volume_size': 1} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:30 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-b23662ee-84ac-4ec9-b413-4ea5b49b1200 req-1614783f-9c5a-4e3b-b967-1865120f6bdd tempest-ServerActionsTestOtherA-2119233136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-141f7022-2215-433e-a993-dfc528d77d98" returned: 0 in 0.658s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-b23662ee-84ac-4ec9-b413-4ea5b49b1200 req-1614783f-9c5a-4e3b-b967-1865120f6bdd tempest-ServerActionsTestOtherA-2119233136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.692s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.025s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1917003489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b08bee-202a-4867-9e47-5f43f81a05b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a093fb7aefd4f1d8bb054f923e9573a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:31:30Z,use_quota=True,user_id='6f9c3b11dadf4fcf875d62ba1a15a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Creating volume 12b08bee-202a-4867-9e47-5f43f81a05b4 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:31:30 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:30 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4 1073741824 Jul 13 20:31:30 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-b23662ee-84ac-4ec9-b413-4ea5b49b1200 req-1614783f-9c5a-4e3b-b967-1865120f6bdd tempest-ServerActionsTestOtherA-2119233136 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-141f7022-2215-433e-a993-dfc528d77d98', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88b9f228-265d-4fc4-a1ac-33233a3e167f', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:31:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-b23662ee-84ac-4ec9-b413-4ea5b49b1200 req-1614783f-9c5a-4e3b-b967-1865120f6bdd tempest-ServerActionsTestOtherA-2119233136 None] attachment_update completed successfully. Jul 13 20:31:31 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4 1073741824" returned: 0 in 0.593s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:31 devstack sudo[90021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4 Jul 13 20:31:31 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:31 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4" returned: 0 in 0.377s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:31:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3897e721-4770-4069-94cf-5a32e05dae34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b08bee-202a-4867-9e47-5f43f81a05b4', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f324929a-87d8-447f-999a-d045fd37cf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:31 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Volume volume-12b08bee-202a-4867-9e47-5f43f81a05b4 (12b08bee-202a-4867-9e47-5f43f81a05b4): created successfully Jul 13 20:31:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f324929a-87d8-447f-999a-d045fd37cf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Flow 'volume_create_manager' (fc477f94-519b-45f3-a26d-09a04c049aff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:31:31 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f18ea356-ae0a-4dd5-958e-1e5a33ab100e tempest-SnapshotsActionsTest-81289323 None] Created volume successfully. Jul 13 20:31:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f4d4b7cc-646e-4aa1-a44c-af8c4b8515f1 tempest-SnapshotsActionsTest-81289323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f4d4b7cc-646e-4aa1-a44c-af8c4b8515f1 tempest-SnapshotsActionsTest-81289323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f4d4b7cc-646e-4aa1-a44c-af8c4b8515f1 tempest-SnapshotsActionsTest-81289323 None] Creating offline snapshot 68a6a151-d3d5-4f14-b47a-66baf32eb7d1 of volume 12b08bee-202a-4867-9e47-5f43f81a05b4 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:31:32 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeafcf2-6562-4a45-882a-6bdb0cbef62e]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4d4b7cc-646e-4aa1-a44c-af8c4b8515f1 tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:33 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4 Jul 13 20:31:33 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:33 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4d4b7cc-646e-4aa1-a44c-af8c4b8515f1 tempest-SnapshotsActionsTest-81289323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4" returned: 0 in 0.549s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4d4b7cc-646e-4aa1-a44c-af8c4b8515f1 tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:33 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 1G Jul 13 20:31:33 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:34 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4d4b7cc-646e-4aa1-a44c-af8c4b8515f1 tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 1G" returned: 0 in 0.572s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4d4b7cc-646e-4aa1-a44c-af8c4b8515f1 tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b08bee-202a-4867-9e47-5f43f81a05b4 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:34 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b08bee-202a-4867-9e47-5f43f81a05b4 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 Jul 13 20:31:34 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:34 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4d4b7cc-646e-4aa1-a44c-af8c4b8515f1 tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b08bee-202a-4867-9e47-5f43f81a05b4 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1" returned: 0 in 0.809s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:34 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-f4d4b7cc-646e-4aa1-a44c-af8c4b8515f1 tempest-SnapshotsActionsTest-81289323 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 is being set with open permissions: ugo+rw Jul 13 20:31:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4d4b7cc-646e-4aa1-a44c-af8c4b8515f1 tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:34 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 Jul 13 20:31:34 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:35 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4d4b7cc-646e-4aa1-a44c-af8c4b8515f1 tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1" returned: 0 in 0.494s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4d4b7cc-646e-4aa1-a44c-af8c4b8515f1 tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:35 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.info Jul 13 20:31:35 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:36 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4d4b7cc-646e-4aa1-a44c-af8c4b8515f1 tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.info" returned: 0 in 0.635s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:36 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-f4d4b7cc-646e-4aa1-a44c-af8c4b8515f1 tempest-SnapshotsActionsTest-81289323 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.info is being set with open permissions: ugo+rw Jul 13 20:31:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4d4b7cc-646e-4aa1-a44c-af8c4b8515f1 tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:36 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.info Jul 13 20:31:36 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:36 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4d4b7cc-646e-4aa1-a44c-af8c4b8515f1 tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.info" returned: 0 in 0.336s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f4d4b7cc-646e-4aa1-a44c-af8c4b8515f1 tempest-SnapshotsActionsTest-81289323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.638s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:36 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f4d4b7cc-646e-4aa1-a44c-af8c4b8515f1 tempest-SnapshotsActionsTest-81289323 None] Create snapshot completed successfully Jul 13 20:31:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8e76ad2a-ad12-42e5-bacb-70e00b0b0437 tempest-SnapshotsActionsTest-81289323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8e76ad2a-ad12-42e5-bacb-70e00b0b0437 tempest-SnapshotsActionsTest-81289323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8e76ad2a-ad12-42e5-bacb-70e00b0b0437 tempest-SnapshotsActionsTest-81289323 None] Creating offline snapshot 2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a of volume 12b08bee-202a-4867-9e47-5f43f81a05b4 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:31:38 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43a2cc3-3faa-4165-bbc7-e985835a0b89]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8e76ad2a-ad12-42e5-bacb-70e00b0b0437 tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:38 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 Jul 13 20:31:38 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:38 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8e76ad2a-ad12-42e5-bacb-70e00b0b0437 tempest-SnapshotsActionsTest-81289323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1" returned: 0 in 0.418s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8e76ad2a-ad12-42e5-bacb-70e00b0b0437 tempest-SnapshotsActionsTest-81289323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12b08bee-202a-4867-9e47-5f43f81a05b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:31:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8e76ad2a-ad12-42e5-bacb-70e00b0b0437 tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:39 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a 1G Jul 13 20:31:39 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:39 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8e76ad2a-ad12-42e5-bacb-70e00b0b0437 tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a 1G" returned: 0 in 0.570s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8e76ad2a-ad12-42e5-bacb-70e00b0b0437 tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:39 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a Jul 13 20:31:39 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:39 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8e76ad2a-ad12-42e5-bacb-70e00b0b0437 tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a" returned: 0 in 0.428s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:39 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-8e76ad2a-ad12-42e5-bacb-70e00b0b0437 tempest-SnapshotsActionsTest-81289323 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a is being set with open permissions: ugo+rw Jul 13 20:31:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8e76ad2a-ad12-42e5-bacb-70e00b0b0437 tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:40 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a Jul 13 20:31:40 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:40 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8e76ad2a-ad12-42e5-bacb-70e00b0b0437 tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a" returned: 0 in 0.334s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8e76ad2a-ad12-42e5-bacb-70e00b0b0437 tempest-SnapshotsActionsTest-81289323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:40 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8e76ad2a-ad12-42e5-bacb-70e00b0b0437 tempest-SnapshotsActionsTest-81289323 None] Create snapshot completed successfully Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] Acquiring lock "cinder-2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Flow 'volume_create_manager' (d0bb628b-f023-4e09-9dfc-6d312e6a5593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87602ac-ec10-4014-a910-55a58b4d4ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] Acquiring lock "cinder-quobyte-12b08bee-202a-4867-9e47-5f43f81a05b4" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87602ac-ec10-4014-a910-55a58b4d4ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-151012396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234237a1-e27e-4d12-a2bb-7e569bd08795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605a50ca52464d98a515cdf445841cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:31:41Z,use_quota=True,user_id='0e5931b9ce4748f6a6180f444e0dbd50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18222d6a-01b2-431f-aacf-e4d054d1e1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18222d6a-01b2-431f-aacf-e4d054d1e1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef038d6a-0283-470c-a20c-6b0a537a09ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef038d6a-0283-470c-a20c-6b0a537a09ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '234237a1-e27e-4d12-a2bb-7e569bd08795', 'volume_name': 'volume-234237a1-e27e-4d12-a2bb-7e569bd08795', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40743a1-2048-4037-a434-d5e999649f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40743a1-2048-4037-a434-d5e999649f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c297115-d597-4c43-ad03-e57c08d5ab4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:40 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Volume 234237a1-e27e-4d12-a2bb-7e569bd08795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-234237a1-e27e-4d12-a2bb-7e569bd08795', 'volume_size': 1} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-151012396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234237a1-e27e-4d12-a2bb-7e569bd08795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605a50ca52464d98a515cdf445841cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:31:41Z,use_quota=True,user_id='0e5931b9ce4748f6a6180f444e0dbd50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Creating volume 234237a1-e27e-4d12-a2bb-7e569bd08795 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:31:40 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-234237a1-e27e-4d12-a2bb-7e569bd08795 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-quobyte-12b08bee-202a-4867-9e47-5f43f81a05b4" acquired by "delete_snapshot" :: waited 0.088s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] Acquiring lock "cinder-quobyte-2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:40 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-234237a1-e27e-4d12-a2bb-7e569bd08795 1073741824 Jul 13 20:31:40 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-quobyte-2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] Deleting offline snapshot 2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a of volume 12b08bee-202a-4867-9e47-5f43f81a05b4 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] snapshot_file for this snap is: volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3aa7a27-b467-425f-8044-bbe2b0d9fc40]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:31:41 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a Jul 13 20:31:41 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Flow 'volume_create_manager' (5defa029-9da6-4e17-885c-a7b234fce4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4318e0e3-3560-4ee9-bdbe-d567f220a3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4318e0e3-3560-4ee9-bdbe-d567f220a3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1669445972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba968cb9-87b0-467c-95b2-81eca38c05a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72c981d346c4dbdbc213f52d6cfec39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:31:41Z,use_quota=True,user_id='e73fb81411f644248d497c67e365b108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460965b6-705c-471e-bc93-57d432667ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460965b6-705c-471e-bc93-57d432667ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1799e6-7db7-441f-acd1-a8669767b61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1799e6-7db7-441f-acd1-a8669767b61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba968cb9-87b0-467c-95b2-81eca38c05a6', 'volume_name': 'volume-ba968cb9-87b0-467c-95b2-81eca38c05a6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2fcd6f-9057-4084-b787-409fe1fa0a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2fcd6f-9057-4084-b787-409fe1fa0a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa5cbe6-0979-426c-b706-43f36b43d7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:41 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Volume ba968cb9-87b0-467c-95b2-81eca38c05a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba968cb9-87b0-467c-95b2-81eca38c05a6', 'volume_size': 1} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:41 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-234237a1-e27e-4d12-a2bb-7e569bd08795 1073741824" returned: 0 in 0.513s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:41 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-234237a1-e27e-4d12-a2bb-7e569bd08795 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a" returned: 0 in 0.448s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12b08bee-202a-4867-9e47-5f43f81a05b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:31:41 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-234237a1-e27e-4d12-a2bb-7e569bd08795 Jul 13 20:31:41 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d294da60-6b53-4011-8c15-dcea0f690500]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:41 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 Jul 13 20:31:41 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:41 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-234237a1-e27e-4d12-a2bb-7e569bd08795" returned: 0 in 0.273s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.470s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1669445972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba968cb9-87b0-467c-95b2-81eca38c05a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72c981d346c4dbdbc213f52d6cfec39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:31:41Z,use_quota=True,user_id='e73fb81411f644248d497c67e365b108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Creating volume ba968cb9-87b0-467c-95b2-81eca38c05a6 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:31:41 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ba968cb9-87b0-467c-95b2-81eca38c05a6 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:41 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ba968cb9-87b0-467c-95b2-81eca38c05a6 1073741824 Jul 13 20:31:41 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c297115-d597-4c43-ad03-e57c08d5ab4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234237a1-e27e-4d12-a2bb-7e569bd08795', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da69dd5d-4ede-4072-8ea9-c055ad8d1c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:41 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Volume volume-234237a1-e27e-4d12-a2bb-7e569bd08795 (234237a1-e27e-4d12-a2bb-7e569bd08795): created successfully Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da69dd5d-4ede-4072-8ea9-c055ad8d1c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Flow 'volume_create_manager' (d0bb628b-f023-4e09-9dfc-6d312e6a5593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:31:41 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a2bfd444-a0c2-4c56-b5e7-a72ff2297b24 tempest-TaggedAttachmentsTest-1415945618 None] Created volume successfully. Jul 13 20:31:41 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1" returned: 0 in 0.437s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12b08bee-202a-4867-9e47-5f43f81a05b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:31:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:41 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a Jul 13 20:31:41 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:42 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ba968cb9-87b0-467c-95b2-81eca38c05a6 1073741824" returned: 0 in 0.472s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ba968cb9-87b0-467c-95b2-81eca38c05a6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:42 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ba968cb9-87b0-467c-95b2-81eca38c05a6 Jul 13 20:31:42 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:42 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a" returned: 0 in 0.395s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:42 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a Jul 13 20:31:42 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:42 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ba968cb9-87b0-467c-95b2-81eca38c05a6" returned: 0 in 0.262s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:31:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa5cbe6-0979-426c-b706-43f36b43d7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba968cb9-87b0-467c-95b2-81eca38c05a6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6d462e-1741-4504-b68d-e42c363c615b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:42 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Volume volume-ba968cb9-87b0-467c-95b2-81eca38c05a6 (ba968cb9-87b0-467c-95b2-81eca38c05a6): created successfully Jul 13 20:31:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6d462e-1741-4504-b68d-e42c363c615b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Flow 'volume_create_manager' (5defa029-9da6-4e17-885c-a7b234fce4a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:31:42 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-09816d9d-0fe6-4e72-94bc-e10d9f27077a tempest-VolumeQuotasAdminTestJSON-1531195584 None] Created volume successfully. Jul 13 20:31:42 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a" returned: 0 in 0.267s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-quobyte-2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a" released by "_delete_snapshot" :: held 1.663s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-quobyte-12b08bee-202a-4867-9e47-5f43f81a05b4" released by "delete_snapshot" :: held 1.706s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:42 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] Created reservations ['fbd6e907-386e-4f86-8f51-80dacbd59297', 'b4de7789-add6-4ff0-9147-d3c530d7184d', '7a46086b-d29c-49ab-88c3-8c331ed2c2d5', 'b68dd376-19e9-4e37-b9c7-61d707af2a06'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:31:42 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] Delete snapshot completed successfully. Jul 13 20:31:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-830192a3-ddca-4bf4-9e9c-f069d18d1fb0 tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-2ee5f4c3-60ef-44f7-bd29-7bec6e42ab2a-delete_snapshot" released by "delete_snapshot" :: held 1.931s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e2881da6-90cc-4c2c-ba2e-8fcc6fa89c7d tempest-SnapshotsActionsTest-81289323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e2881da6-90cc-4c2c-ba2e-8fcc6fa89c7d tempest-SnapshotsActionsTest-81289323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e2881da6-90cc-4c2c-ba2e-8fcc6fa89c7d tempest-SnapshotsActionsTest-81289323 None] Creating offline snapshot 7d24564a-ac76-468e-bef1-7d34c76edd54 of volume 12b08bee-202a-4867-9e47-5f43f81a05b4 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:31:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Acquiring lock "cinder-ba968cb9-87b0-467c-95b2-81eca38c05a6-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:43 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcac73a6-5845-4045-8347-74ed84f146cb]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e2881da6-90cc-4c2c-ba2e-8fcc6fa89c7d tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Lock "cinder-ba968cb9-87b0-467c-95b2-81eca38c05a6-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Acquiring lock "cinder-quobyte-ba968cb9-87b0-467c-95b2-81eca38c05a6" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Lock "cinder-quobyte-ba968cb9-87b0-467c-95b2-81eca38c05a6" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:43 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[04961295-3d98-4d2d-ad52-aeb18c715d3a]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ba968cb9-87b0-467c-95b2-81eca38c05a6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:43 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 Jul 13 20:31:43 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:43 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ba968cb9-87b0-467c-95b2-81eca38c05a6 Jul 13 20:31:43 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:43 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e2881da6-90cc-4c2c-ba2e-8fcc6fa89c7d tempest-SnapshotsActionsTest-81289323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1" returned: 0 in 0.537s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e2881da6-90cc-4c2c-ba2e-8fcc6fa89c7d tempest-SnapshotsActionsTest-81289323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12b08bee-202a-4867-9e47-5f43f81a05b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:31:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e2881da6-90cc-4c2c-ba2e-8fcc6fa89c7d tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:43 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54 1G Jul 13 20:31:43 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:44 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ba968cb9-87b0-467c-95b2-81eca38c05a6" returned: 0 in 0.550s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ba968cb9-87b0-467c-95b2-81eca38c05a6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:44 devstack sudo[90621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ba968cb9-87b0-467c-95b2-81eca38c05a6 Jul 13 20:31:44 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:44 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ba968cb9-87b0-467c-95b2-81eca38c05a6" returned: 0 in 0.320s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Lock "cinder-quobyte-ba968cb9-87b0-467c-95b2-81eca38c05a6" released by "delete_volume" :: held 0.923s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:44 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Created reservations ['2312858b-c7d1-4ff9-ac4b-ec8923d73758', '52aba8f6-d182-4594-8c9b-6a19377d9654', '1be24ad5-6b4e-40d8-90bd-788a4d84c90f', '57c0e2cc-d01a-4d7b-8c18-afb7dccccd05'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:31:44 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e2881da6-90cc-4c2c-ba2e-8fcc6fa89c7d tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54 1G" returned: 0 in 0.679s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e2881da6-90cc-4c2c-ba2e-8fcc6fa89c7d tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:31:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:31:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:44 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54 Jul 13 20:31:44 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:44 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:31:44 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:44 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e2881da6-90cc-4c2c-ba2e-8fcc6fa89c7d tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54" returned: 0 in 0.311s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:44 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-e2881da6-90cc-4c2c-ba2e-8fcc6fa89c7d tempest-SnapshotsActionsTest-81289323 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54 is being set with open permissions: ugo+rw Jul 13 20:31:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e2881da6-90cc-4c2c-ba2e-8fcc6fa89c7d tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:44 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54 Jul 13 20:31:44 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:44 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.329s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:44 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:31:44 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Deleted volume successfully. Jul 13 20:31:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0283de3f-cf18-4fe4-847e-20182113bcf5 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Lock "cinder-ba968cb9-87b0-467c-95b2-81eca38c05a6-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:45 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e2881da6-90cc-4c2c-ba2e-8fcc6fa89c7d tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54" returned: 0 in 0.289s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e2881da6-90cc-4c2c-ba2e-8fcc6fa89c7d tempest-SnapshotsActionsTest-81289323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:45 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e2881da6-90cc-4c2c-ba2e-8fcc6fa89c7d tempest-SnapshotsActionsTest-81289323 None] Create snapshot completed successfully Jul 13 20:31:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] Acquiring lock "cinder-7d24564a-ac76-468e-bef1-7d34c76edd54-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-7d24564a-ac76-468e-bef1-7d34c76edd54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] Acquiring lock "cinder-quobyte-12b08bee-202a-4867-9e47-5f43f81a05b4" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-quobyte-12b08bee-202a-4867-9e47-5f43f81a05b4" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] Acquiring lock "cinder-quobyte-7d24564a-ac76-468e-bef1-7d34c76edd54" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-quobyte-7d24564a-ac76-468e-bef1-7d34c76edd54" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] Deleting offline snapshot 7d24564a-ac76-468e-bef1-7d34c76edd54 of volume 12b08bee-202a-4867-9e47-5f43f81a05b4 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:31:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] snapshot_file for this snap is: volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:31:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d83642-0c04-4b8b-b3da-8467ed108c23]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:45 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54 Jul 13 20:31:45 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:46 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54" returned: 0 in 0.538s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12b08bee-202a-4867-9e47-5f43f81a05b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Flow 'volume_create_manager' (6f84d725-6a8a-40c6-a229-84ef0db75a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87c163f-4452-4eef-a518-092c710878e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e92e5f-cdba-4900-ae75-bbcf28e3dfbc]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87c163f-4452-4eef-a518-092c710878e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1435018546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2195d0da-002f-44df-8113-165d4cf01f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72c981d346c4dbdbc213f52d6cfec39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:31:46Z,use_quota=True,user_id='e73fb81411f644248d497c67e365b108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a985104b-90ca-4164-82ec-9aa697d81bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a985104b-90ca-4164-82ec-9aa697d81bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0b6ea2-3231-4a9c-b335-26aa7ce39bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0b6ea2-3231-4a9c-b335-26aa7ce39bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2195d0da-002f-44df-8113-165d4cf01f8a', 'volume_name': 'volume-2195d0da-002f-44df-8113-165d4cf01f8a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e03effe-c9c5-4670-ae1b-c90e140bd209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e03effe-c9c5-4670-ae1b-c90e140bd209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5944d395-60ce-4085-a93c-83f74fac4bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:46 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Volume 2195d0da-002f-44df-8113-165d4cf01f8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2195d0da-002f-44df-8113-165d4cf01f8a', 'volume_size': 1} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1435018546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2195d0da-002f-44df-8113-165d4cf01f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72c981d346c4dbdbc213f52d6cfec39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:31:46Z,use_quota=True,user_id='e73fb81411f644248d497c67e365b108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Creating volume 2195d0da-002f-44df-8113-165d4cf01f8a {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:31:46 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2195d0da-002f-44df-8113-165d4cf01f8a 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:46 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2195d0da-002f-44df-8113-165d4cf01f8a 1073741824 Jul 13 20:31:46 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:46 devstack sudo[90645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 Jul 13 20:31:46 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:46 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1" returned: 0 in 0.523s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12b08bee-202a-4867-9e47-5f43f81a05b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:31:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:46 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54 Jul 13 20:31:46 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:47 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2195d0da-002f-44df-8113-165d4cf01f8a 1073741824" returned: 0 in 0.606s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2195d0da-002f-44df-8113-165d4cf01f8a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:47 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2195d0da-002f-44df-8113-165d4cf01f8a Jul 13 20:31:47 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:47 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2195d0da-002f-44df-8113-165d4cf01f8a" returned: 0 in 0.369s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:31:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5944d395-60ce-4085-a93c-83f74fac4bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2195d0da-002f-44df-8113-165d4cf01f8a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5596ccc-f35e-4008-a172-8e576fc6042d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:31:47 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54" returned: 0 in 0.681s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:47 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Volume volume-2195d0da-002f-44df-8113-165d4cf01f8a (2195d0da-002f-44df-8113-165d4cf01f8a): created successfully Jul 13 20:31:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5596ccc-f35e-4008-a172-8e576fc6042d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:31:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Flow 'volume_create_manager' (6f84d725-6a8a-40c6-a229-84ef0db75a7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:31:47 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54 Jul 13 20:31:47 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-715c4536-5297-4a0b-8e93-babdfe1b6923 tempest-VolumeQuotasAdminTestJSON-1531195584 None] Created volume successfully. Jul 13 20:31:47 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.7d24564a-ac76-468e-bef1-7d34c76edd54" returned: 0 in 0.354s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-quobyte-7d24564a-ac76-468e-bef1-7d34c76edd54" released by "_delete_snapshot" :: held 2.256s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-quobyte-12b08bee-202a-4867-9e47-5f43f81a05b4" released by "delete_snapshot" :: held 2.282s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:48 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] Created reservations ['368efb45-91fd-44e4-a3e9-240eb7e0a0c8', 'f8b30997-8243-4118-85af-07d7c8cb75bb', '7f9614ce-3687-4526-a2bd-e066cbe42b24', '1377c8d1-5a58-44ce-b19e-773afe93ed27'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:31:48 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] Delete snapshot completed successfully. Jul 13 20:31:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-08fb3e8a-84ae-4cff-8955-ed9acfdfaca8 tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-7d24564a-ac76-468e-bef1-7d34c76edd54-delete_snapshot" released by "delete_snapshot" :: held 2.435s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:49 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c75ce5c7-589a-4c71-a50e-da0564977b12 tempest-VolumeQuotasAdminTestJSON-1048391626 None] Transfer volume completed successfully. Jul 13 20:31:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-90273188-921e-4478-8b37-b5b7a20ef48f tempest-SnapshotsActionsTest-81289323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-90273188-921e-4478-8b37-b5b7a20ef48f tempest-SnapshotsActionsTest-81289323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-90273188-921e-4478-8b37-b5b7a20ef48f tempest-SnapshotsActionsTest-81289323 None] Creating offline snapshot 14ebe57f-f3c8-4d0e-bd4a-e3288163a88e of volume 12b08bee-202a-4867-9e47-5f43f81a05b4 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:31:49 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[97464c95-4b72-4f3e-bed3-9e1c9863e838]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-90273188-921e-4478-8b37-b5b7a20ef48f tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:49 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 Jul 13 20:31:49 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] Acquiring lock "cinder-2195d0da-002f-44df-8113-165d4cf01f8a-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] Lock "cinder-2195d0da-002f-44df-8113-165d4cf01f8a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:49 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-90273188-921e-4478-8b37-b5b7a20ef48f tempest-SnapshotsActionsTest-81289323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1" returned: 0 in 0.471s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-90273188-921e-4478-8b37-b5b7a20ef48f tempest-SnapshotsActionsTest-81289323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12b08bee-202a-4867-9e47-5f43f81a05b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:31:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-90273188-921e-4478-8b37-b5b7a20ef48f tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] Acquiring lock "cinder-quobyte-2195d0da-002f-44df-8113-165d4cf01f8a" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:50 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e 1G Jul 13 20:31:50 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] Lock "cinder-quobyte-2195d0da-002f-44df-8113-165d4cf01f8a" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:50 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0f5b0a-c4f4-4f9b-b851-0689c84e982a]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2195d0da-002f-44df-8113-165d4cf01f8a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:50 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2195d0da-002f-44df-8113-165d4cf01f8a Jul 13 20:31:50 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:50 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-90273188-921e-4478-8b37-b5b7a20ef48f tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e 1G" returned: 0 in 0.506s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-90273188-921e-4478-8b37-b5b7a20ef48f tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:50 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2195d0da-002f-44df-8113-165d4cf01f8a" returned: 0 in 0.450s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2195d0da-002f-44df-8113-165d4cf01f8a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:50 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e Jul 13 20:31:50 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:50 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2195d0da-002f-44df-8113-165d4cf01f8a Jul 13 20:31:50 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:50 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2195d0da-002f-44df-8113-165d4cf01f8a" returned: 0 in 0.274s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] Lock "cinder-quobyte-2195d0da-002f-44df-8113-165d4cf01f8a" released by "delete_volume" :: held 0.773s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:50 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-90273188-921e-4478-8b37-b5b7a20ef48f tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e" returned: 0 in 0.323s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:50 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-90273188-921e-4478-8b37-b5b7a20ef48f tempest-SnapshotsActionsTest-81289323 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e is being set with open permissions: ugo+rw Jul 13 20:31:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-90273188-921e-4478-8b37-b5b7a20ef48f tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:50 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e Jul 13 20:31:50 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:50 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] Created reservations ['84fd3e64-ef4f-4bb0-87b8-45345975f9fb', '72240888-2557-4675-87b2-be4f5e8a62ef', 'd8f67cd2-b775-4042-8b43-926c06acca64', 'f81f3001-761c-44eb-825e-14e9fbde02c6'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:31:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:31:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:31:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:50 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:31:50 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:51 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-90273188-921e-4478-8b37-b5b7a20ef48f tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e" returned: 0 in 0.474s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:51 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-90273188-921e-4478-8b37-b5b7a20ef48f tempest-SnapshotsActionsTest-81289323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.419s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:51 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:31:51 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] Deleted volume successfully. Jul 13 20:31:51 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-90273188-921e-4478-8b37-b5b7a20ef48f tempest-SnapshotsActionsTest-81289323 None] Create snapshot completed successfully Jul 13 20:31:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dc557f06-1f53-40b5-abb3-f7f84858c402 tempest-VolumeQuotasAdminTestJSON-1151687696 None] Lock "cinder-2195d0da-002f-44df-8113-165d4cf01f8a-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] Acquiring lock "cinder-14ebe57f-f3c8-4d0e-bd4a-e3288163a88e-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-14ebe57f-f3c8-4d0e-bd4a-e3288163a88e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] Acquiring lock "cinder-quobyte-12b08bee-202a-4867-9e47-5f43f81a05b4" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-quobyte-12b08bee-202a-4867-9e47-5f43f81a05b4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] Acquiring lock "cinder-quobyte-14ebe57f-f3c8-4d0e-bd4a-e3288163a88e" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-quobyte-14ebe57f-f3c8-4d0e-bd4a-e3288163a88e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] Deleting offline snapshot 14ebe57f-f3c8-4d0e-bd4a-e3288163a88e of volume 12b08bee-202a-4867-9e47-5f43f81a05b4 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:31:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] snapshot_file for this snap is: volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:31:51 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6efa61a-50d9-4d52-9748-611ba18cc35a]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:52 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e Jul 13 20:31:52 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:52 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e" returned: 0 in 0.658s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12b08bee-202a-4867-9e47-5f43f81a05b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:31:52 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[80468850-2e65-45c4-bfc3-68208f078cfe]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:52 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 Jul 13 20:31:52 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:53 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1" returned: 0 in 0.401s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12b08bee-202a-4867-9e47-5f43f81a05b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:31:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:53 devstack sudo[90848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e Jul 13 20:31:53 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:53 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e" returned: 0 in 0.652s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:53 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e Jul 13 20:31:53 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:54 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.14ebe57f-f3c8-4d0e-bd4a-e3288163a88e" returned: 0 in 0.435s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-quobyte-14ebe57f-f3c8-4d0e-bd4a-e3288163a88e" released by "_delete_snapshot" :: held 2.313s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-quobyte-12b08bee-202a-4867-9e47-5f43f81a05b4" released by "delete_snapshot" :: held 2.342s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:54 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] Created reservations ['5110b84d-6f78-4935-afbe-dddd0dcb03b2', '6902c795-6410-4475-90c2-2cf2c15c3e3a', 'fff5d563-eea0-45a2-a516-975afc86ecd9', '0229d4a9-dd64-439e-9018-be5bd6b65184'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:31:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] Delete snapshot completed successfully. Jul 13 20:31:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d035c5f3-046e-4f1f-b0dc-016ea85a7f71 tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-14ebe57f-f3c8-4d0e-bd4a-e3288163a88e-delete_snapshot" released by "delete_snapshot" :: held 2.583s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:31:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bf25078e-9e79-4ea6-a8bb-aeeae81475df tempest-SnapshotsActionsTest-81289323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:31:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bf25078e-9e79-4ea6-a8bb-aeeae81475df tempest-SnapshotsActionsTest-81289323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:31:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-bf25078e-9e79-4ea6-a8bb-aeeae81475df tempest-SnapshotsActionsTest-81289323 None] Creating offline snapshot de74dcbe-82bc-4011-85f7-d5b1229bcc7b of volume 12b08bee-202a-4867-9e47-5f43f81a05b4 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:31:55 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e761662-24d5-4f3f-b674-8e80980651ab]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf25078e-9e79-4ea6-a8bb-aeeae81475df tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:55 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 Jul 13 20:31:55 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:56 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf25078e-9e79-4ea6-a8bb-aeeae81475df tempest-SnapshotsActionsTest-81289323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1" returned: 0 in 0.936s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-bf25078e-9e79-4ea6-a8bb-aeeae81475df tempest-SnapshotsActionsTest-81289323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12b08bee-202a-4867-9e47-5f43f81a05b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:31:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf25078e-9e79-4ea6-a8bb-aeeae81475df tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:56 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b 1G Jul 13 20:31:56 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:57 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf25078e-9e79-4ea6-a8bb-aeeae81475df tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b 1G" returned: 0 in 0.642s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf25078e-9e79-4ea6-a8bb-aeeae81475df tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:57 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b Jul 13 20:31:57 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:57 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf25078e-9e79-4ea6-a8bb-aeeae81475df tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b" returned: 0 in 0.508s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:57 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-bf25078e-9e79-4ea6-a8bb-aeeae81475df tempest-SnapshotsActionsTest-81289323 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b is being set with open permissions: ugo+rw Jul 13 20:31:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf25078e-9e79-4ea6-a8bb-aeeae81475df tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:57 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b Jul 13 20:31:57 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:58 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf25078e-9e79-4ea6-a8bb-aeeae81475df tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b" returned: 0 in 0.362s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bf25078e-9e79-4ea6-a8bb-aeeae81475df tempest-SnapshotsActionsTest-81289323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.652s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:31:58 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-bf25078e-9e79-4ea6-a8bb-aeeae81475df tempest-SnapshotsActionsTest-81289323 None] Create snapshot completed successfully Jul 13 20:31:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] Acquiring lock "cinder-de74dcbe-82bc-4011-85f7-d5b1229bcc7b-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-de74dcbe-82bc-4011-85f7-d5b1229bcc7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] Acquiring lock "cinder-quobyte-12b08bee-202a-4867-9e47-5f43f81a05b4" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-quobyte-12b08bee-202a-4867-9e47-5f43f81a05b4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] Acquiring lock "cinder-quobyte-de74dcbe-82bc-4011-85f7-d5b1229bcc7b" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:31:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-quobyte-de74dcbe-82bc-4011-85f7-d5b1229bcc7b" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:31:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] Deleting offline snapshot de74dcbe-82bc-4011-85f7-d5b1229bcc7b of volume 12b08bee-202a-4867-9e47-5f43f81a05b4 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:31:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] snapshot_file for this snap is: volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:31:59 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05731f8-5330-43cf-8096-b53b57874bfd]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:59 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-b44978ca-1746-42dc-a631-32bffe6b67a0 req-2d80b022-9118-4087-852a-3123fe0db894 tempest-ServerActionsTestOtherA-2119233136 None] Terminate volume connection completed successfully. Jul 13 20:31:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-b44978ca-1746-42dc-a631-32bffe6b67a0 req-2d80b022-9118-4087-852a-3123fe0db894 tempest-ServerActionsTestOtherA-2119233136 None] Deleting attachment 88b9f228-265d-4fc4-a1ac-33233a3e167f. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:31:59 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b Jul 13 20:31:59 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:31:59 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Jul 13 20:31:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b" returned: 0 in 0.442s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:31:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12b08bee-202a-4867-9e47-5f43f81a05b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:31:59 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2660178a-5d93-4f4b-8c21-083e6cfdc61b]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:31:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:31:59 devstack sudo[90899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 Jul 13 20:31:59 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:00 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1" returned: 0 in 0.562s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12b08bee-202a-4867-9e47-5f43f81a05b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:32:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:00 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b Jul 13 20:32:00 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:00 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b" returned: 0 in 0.790s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:00 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b Jul 13 20:32:00 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:01 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.de74dcbe-82bc-4011-85f7-d5b1229bcc7b" returned: 0 in 0.425s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-quobyte-de74dcbe-82bc-4011-85f7-d5b1229bcc7b" released by "_delete_snapshot" :: held 2.399s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-quobyte-12b08bee-202a-4867-9e47-5f43f81a05b4" released by "delete_snapshot" :: held 2.452s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:01 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] Created reservations ['f6557567-7f8b-4091-aa02-9e9f4ee714e0', 'd48c8c47-1873-4a78-a7a8-4f0703adaa74', '6d428176-3bbc-439b-be09-1892aa54f891', '89191d85-8e3c-440f-baca-5b75d18ae21d'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:32:01 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] Delete snapshot completed successfully. Jul 13 20:32:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8ad1b049-5ec7-42d2-b547-4dd09c6f918c tempest-SnapshotsActionsTest-549602353 None] Lock "cinder-de74dcbe-82bc-4011-85f7-d5b1229bcc7b-delete_snapshot" released by "delete_snapshot" :: held 2.701s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Flow 'volume_create_manager' (b927cacd-0f0d-43a7-a11c-1ca2da1a6750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7b3345-e7ac-45e3-899d-c19f7d2aefd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7b3345-e7ac-45e3-899d-c19f7d2aefd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1642308444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5abab00-8f5f-4a31-b13c-20601f4554d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7f43661ad44f968590f243bb2ee263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:32:03Z,use_quota=True,user_id='47f5e39d7f9f4a90812a1dc1f16f4147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7d312a6-e930-4c1b-b8d5-145fdb2914ac),volume_type_id=b7d312a6-e930-4c1b-b8d5-145fdb2914ac)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20966f35-1eb1-4c61-9fd4-4590e92dfe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20966f35-1eb1-4c61-9fd4-4590e92dfe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b133e67-c038-4601-8b77-9a7c776feee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b133e67-c038-4601-8b77-9a7c776feee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5abab00-8f5f-4a31-b13c-20601f4554d7', 'volume_name': 'volume-a5abab00-8f5f-4a31-b13c-20601f4554d7', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e70b214-92f4-4b2e-8010-95c3ca691bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e70b214-92f4-4b2e-8010-95c3ca691bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d917d2-908c-4c91-9dd6-ca6bb63feb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:32:02 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Volume a5abab00-8f5f-4a31-b13c-20601f4554d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5abab00-8f5f-4a31-b13c-20601f4554d7', 'volume_size': 1} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1642308444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5abab00-8f5f-4a31-b13c-20601f4554d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7f43661ad44f968590f243bb2ee263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:32:03Z,use_quota=True,user_id='47f5e39d7f9f4a90812a1dc1f16f4147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7d312a6-e930-4c1b-b8d5-145fdb2914ac),volume_type_id=b7d312a6-e930-4c1b-b8d5-145fdb2914ac)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Creating volume a5abab00-8f5f-4a31-b13c-20601f4554d7 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:32:02 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:32:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a5abab00-8f5f-4a31-b13c-20601f4554d7 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:02 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a5abab00-8f5f-4a31-b13c-20601f4554d7 1073741824 Jul 13 20:32:02 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] Acquiring lock "cinder-68a6a151-d3d5-4f14-b47a-66baf32eb7d1-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:32:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] Lock "cinder-68a6a151-d3d5-4f14-b47a-66baf32eb7d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:32:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] Acquiring lock "cinder-quobyte-12b08bee-202a-4867-9e47-5f43f81a05b4" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:32:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] Lock "cinder-quobyte-12b08bee-202a-4867-9e47-5f43f81a05b4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:32:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] Acquiring lock "cinder-quobyte-68a6a151-d3d5-4f14-b47a-66baf32eb7d1" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:32:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] Lock "cinder-quobyte-68a6a151-d3d5-4f14-b47a-66baf32eb7d1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:32:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] Deleting offline snapshot 68a6a151-d3d5-4f14-b47a-66baf32eb7d1 of volume 12b08bee-202a-4867-9e47-5f43f81a05b4 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:32:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] snapshot_file for this snap is: volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:32:03 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3505bd-9002-4663-be36-4db12c83b4d9]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:32:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:03 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 Jul 13 20:32:03 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:03 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a5abab00-8f5f-4a31-b13c-20601f4554d7 1073741824" returned: 0 in 0.791s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a5abab00-8f5f-4a31-b13c-20601f4554d7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:03 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a5abab00-8f5f-4a31-b13c-20601f4554d7 Jul 13 20:32:03 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:03 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1" returned: 0 in 0.538s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12b08bee-202a-4867-9e47-5f43f81a05b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:32:03 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5040d5-e94b-4d79-86e2-976925688f0a]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:32:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:04 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a5abab00-8f5f-4a31-b13c-20601f4554d7" returned: 0 in 0.322s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:32:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:32:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d917d2-908c-4c91-9dd6-ca6bb63feb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5abab00-8f5f-4a31-b13c-20601f4554d7', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:32:04 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4 Jul 13 20:32:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ef14d5-97e7-4245-8b14-4e54cbb6049d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:32:04 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Volume volume-a5abab00-8f5f-4a31-b13c-20601f4554d7 (a5abab00-8f5f-4a31-b13c-20601f4554d7): created successfully Jul 13 20:32:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ef14d5-97e7-4245-8b14-4e54cbb6049d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:32:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Flow 'volume_create_manager' (b927cacd-0f0d-43a7-a11c-1ca2da1a6750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:32:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b7ae2bb2-aee5-4826-996f-75620b72a99a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Created volume successfully. Jul 13 20:32:04 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4" returned: 0 in 0.392s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:04 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 Jul 13 20:32:04 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:04 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1" returned: 0 in 0.497s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:04 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1 Jul 13 20:32:04 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:05 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4.68a6a151-d3d5-4f14-b47a-66baf32eb7d1" returned: 0 in 0.342s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] Lock "cinder-quobyte-68a6a151-d3d5-4f14-b47a-66baf32eb7d1" released by "_delete_snapshot" :: held 1.904s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] Lock "cinder-quobyte-12b08bee-202a-4867-9e47-5f43f81a05b4" released by "delete_snapshot" :: held 1.940s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:05 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] Created reservations ['92201121-fcbb-4566-9e3a-488651428a71', 'b2cf2c34-f7cf-4b8d-abe2-071c3c3b7e01', '26c45f99-1643-4dd9-a0e0-1829a77a3e60', '9f87af55-123a-44b8-9bba-dff94a4cdb63'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:32:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-22b8eaaa-f8cb-46de-a147-851b95406d1a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:32:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-22b8eaaa-f8cb-46de-a147-851b95406d1a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:32:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-22b8eaaa-f8cb-46de-a147-851b95406d1a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:32:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-22b8eaaa-f8cb-46de-a147-851b95406d1a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:32:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-22b8eaaa-f8cb-46de-a147-851b95406d1a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:32:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-22b8eaaa-f8cb-46de-a147-851b95406d1a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:05 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:32:05 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] Delete snapshot completed successfully. Jul 13 20:32:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7c517a33-1d9c-4fd0-a718-f1e5fd778036 tempest-SnapshotsActionsTest-81289323 None] Lock "cinder-68a6a151-d3d5-4f14-b47a-66baf32eb7d1-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] Acquiring lock "cinder-141f7022-2215-433e-a993-dfc528d77d98-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:32:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] Lock "cinder-141f7022-2215-433e-a993-dfc528d77d98-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:32:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] Acquiring lock "cinder-quobyte-141f7022-2215-433e-a993-dfc528d77d98" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:32:05 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-22b8eaaa-f8cb-46de-a147-851b95406d1a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.313s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:05 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-22b8eaaa-f8cb-46de-a147-851b95406d1a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:32:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] Lock "cinder-quobyte-141f7022-2215-433e-a993-dfc528d77d98" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:32:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-22b8eaaa-f8cb-46de-a147-851b95406d1a tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Retype volume completed successfully. Jul 13 20:32:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[827359bf-c137-4b02-adce-3d233f28972d]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:32:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-141f7022-2215-433e-a993-dfc528d77d98 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:05 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-141f7022-2215-433e-a993-dfc528d77d98 Jul 13 20:32:05 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:06 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-141f7022-2215-433e-a993-dfc528d77d98" returned: 0 in 0.352s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-141f7022-2215-433e-a993-dfc528d77d98 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:06 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-141f7022-2215-433e-a993-dfc528d77d98 Jul 13 20:32:06 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:06 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-141f7022-2215-433e-a993-dfc528d77d98" returned: 0 in 0.265s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] Lock "cinder-quobyte-141f7022-2215-433e-a993-dfc528d77d98" released by "delete_volume" :: held 0.658s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] Created reservations ['a58161cb-173e-4dd0-b6e0-748df4d87c67', 'f659fc08-ecf9-44be-8f09-9b0e058024d3', '2714c046-3ec6-4bc6-8588-c02e753d47e3', '875aec23-b9d0-4567-84c8-7bb4a34e16f3'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:06 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:32:06 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Acquiring lock "cinder-a5abab00-8f5f-4a31-b13c-20601f4554d7-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Lock "cinder-a5abab00-8f5f-4a31-b13c-20601f4554d7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] Acquiring lock "cinder-12b08bee-202a-4867-9e47-5f43f81a05b4-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] Lock "cinder-12b08bee-202a-4867-9e47-5f43f81a05b4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Acquiring lock "cinder-quobyte-a5abab00-8f5f-4a31-b13c-20601f4554d7" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] Acquiring lock "cinder-quobyte-12b08bee-202a-4867-9e47-5f43f81a05b4" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Lock "cinder-quobyte-a5abab00-8f5f-4a31-b13c-20601f4554d7" acquired by "delete_volume" :: waited 0.037s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] Lock "cinder-quobyte-12b08bee-202a-4867-9e47-5f43f81a05b4" acquired by "delete_volume" :: waited 0.065s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f702bb-eb73-4b67-a6e1-59ebcc97acc1]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a5abab00-8f5f-4a31-b13c-20601f4554d7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f646bb9-0195-4419-8f89-ec8fc490014e]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:06 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.499s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:06 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:32:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] Deleted volume successfully. Jul 13 20:32:07 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a5abab00-8f5f-4a31-b13c-20601f4554d7 Jul 13 20:32:07 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-af8e278e-f082-41ba-9181-2d5fa47a3315 tempest-ServerActionsTestOtherA-2119233136 None] Lock "cinder-141f7022-2215-433e-a993-dfc528d77d98-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:07 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4 Jul 13 20:32:07 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:07 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4" returned: 0 in 0.717s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:07 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a5abab00-8f5f-4a31-b13c-20601f4554d7" returned: 0 in 0.800s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a5abab00-8f5f-4a31-b13c-20601f4554d7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:07 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a5abab00-8f5f-4a31-b13c-20601f4554d7 Jul 13 20:32:07 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4 Jul 13 20:32:07 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:07 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:07 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a5abab00-8f5f-4a31-b13c-20601f4554d7" returned: 0 in 0.415s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:08 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-12b08bee-202a-4867-9e47-5f43f81a05b4" returned: 0 in 0.489s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Lock "cinder-quobyte-a5abab00-8f5f-4a31-b13c-20601f4554d7" released by "delete_volume" :: held 1.346s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] Lock "cinder-quobyte-12b08bee-202a-4867-9e47-5f43f81a05b4" released by "delete_volume" :: held 1.300s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:08 devstack cinder-volume[87269]: WARNING cinder.quota [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:32:08 devstack cinder-volume[87269]: WARNING cinder.quota [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Created reservations ['5cc63cb3-1e75-48b9-8608-f8ff5d8cfc95', 'd4092d98-4d94-43e6-9d19-c23694df0fc4', 'd017f683-702e-45cb-9a40-ae71ff04bad8', 'ce522bd7-243e-4a85-9996-0a846d5b0b21'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] Created reservations ['ecd045fe-42a6-4226-8974-81b725caa9f8', '4cfd9140-028c-4f9b-99d2-1d52ca6f15bc', 'e65b4088-ff5b-4553-aba1-732b9962b80f', '338aee62-eb2a-4cde-9a93-1dee284ffa36'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:08 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:32:08 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:08 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:32:08 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:08 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.333s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:32:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Deleted volume successfully. Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-075ed286-ddea-4591-b34e-c3558fa85cdd tempest-VolumeRetypeWithoutMigrationTest-1483328372 None] Lock "cinder-a5abab00-8f5f-4a31-b13c-20601f4554d7-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:08 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:32:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] Deleted volume successfully. Jul 13 20:32:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f678399-1b35-4e3d-a637-0d6b6edcb586 tempest-SnapshotsActionsTest-81289323 None] Lock "cinder-12b08bee-202a-4867-9e47-5f43f81a05b4-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:18 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=102,cinder:SELECT=93,cinder:INSERT=24,cinder:DELETE=4 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:32:18 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=104,cinder:INSERT=23,cinder:UPDATE=97,cinder:DELETE=11 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:32:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:32:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:32:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:32:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:32:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:32:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:32:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:18 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:32:18 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:19 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.296s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:32:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:32:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 8 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:32:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:32:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-3e97e0ef-756b-49ff-9f92-33bee34828fd req-a4d75bfe-0c8b-47d4-a89e-6e3779985a38 tempest-TaggedAttachmentsTest-1415945618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:32:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-3e97e0ef-756b-49ff-9f92-33bee34828fd req-a4d75bfe-0c8b-47d4-a89e-6e3779985a38 tempest-TaggedAttachmentsTest-1415945618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:32:27 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdef4fd-1151-4902-8ef1-d1b29d932346]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:32:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-3e97e0ef-756b-49ff-9f92-33bee34828fd req-a4d75bfe-0c8b-47d4-a89e-6e3779985a38 tempest-TaggedAttachmentsTest-1415945618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-234237a1-e27e-4d12-a2bb-7e569bd08795 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:27 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-234237a1-e27e-4d12-a2bb-7e569bd08795 Jul 13 20:32:27 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:28 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-3e97e0ef-756b-49ff-9f92-33bee34828fd req-a4d75bfe-0c8b-47d4-a89e-6e3779985a38 tempest-TaggedAttachmentsTest-1415945618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-234237a1-e27e-4d12-a2bb-7e569bd08795" returned: 0 in 0.570s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-3e97e0ef-756b-49ff-9f92-33bee34828fd req-a4d75bfe-0c8b-47d4-a89e-6e3779985a38 tempest-TaggedAttachmentsTest-1415945618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.610s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:32:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-3e97e0ef-756b-49ff-9f92-33bee34828fd req-a4d75bfe-0c8b-47d4-a89e-6e3779985a38 tempest-TaggedAttachmentsTest-1415945618 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-234237a1-e27e-4d12-a2bb-7e569bd08795', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'faddbeb9-34ae-45fc-a9db-4930ea44e457', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:32:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-3e97e0ef-756b-49ff-9f92-33bee34828fd req-a4d75bfe-0c8b-47d4-a89e-6e3779985a38 tempest-TaggedAttachmentsTest-1415945618 None] attachment_update completed successfully. Jul 13 20:32:33 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-d59e46a7-af09-4444-aa0a-af76d0cfaa25 req-f0c5dca5-20ec-4345-ba69-854237dc7939 tempest-TaggedAttachmentsTest-1415945618 None] Terminate volume connection completed successfully. Jul 13 20:32:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-d59e46a7-af09-4444-aa0a-af76d0cfaa25 req-f0c5dca5-20ec-4345-ba69-854237dc7939 tempest-TaggedAttachmentsTest-1415945618 None] Deleting attachment faddbeb9-34ae-45fc-a9db-4930ea44e457. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:32:36 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:32:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Flow 'volume_create_manager' (cb6f8779-44e8-4fb1-8eab-32a77db42753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:32:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367090a2-5071-4e67-8531-2d6cdff9f8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:32:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367090a2-5071-4e67-8531-2d6cdff9f8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-428764852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d16d26-1f98-4fe4-a65b-b0a3ba8df01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a159ab83122b49d581d58b574189e51b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:32:37Z,use_quota=True,user_id='b165fe4fb82f439ca7b0689d338e7d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87851544-1496-4539-9119-3e120cf745b2),volume_type_id=87851544-1496-4539-9119-3e120cf745b2)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a7cdf0-1890-4d88-a5a8-47c3efbef4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a7cdf0-1890-4d88-a5a8-47c3efbef4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50c25b0-2781-40b3-a678-5e32b35ab6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50c25b0-2781-40b3-a678-5e32b35ab6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89d16d26-1f98-4fe4-a65b-b0a3ba8df01f', 'volume_name': 'volume-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e64031-b250-4714-a13a-a9a78deedd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e64031-b250-4714-a13a-a9a78deedd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8aabb7-7d65-4c2c-b1f5-ce2741f7d12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:32:37 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Volume 89d16d26-1f98-4fe4-a65b-b0a3ba8df01f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f', 'volume_size': 1} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-428764852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d16d26-1f98-4fe4-a65b-b0a3ba8df01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a159ab83122b49d581d58b574189e51b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:32:37Z,use_quota=True,user_id='b165fe4fb82f439ca7b0689d338e7d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87851544-1496-4539-9119-3e120cf745b2),volume_type_id=87851544-1496-4539-9119-3e120cf745b2)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Creating volume 89d16d26-1f98-4fe4-a65b-b0a3ba8df01f {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:32:37 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:37 devstack sudo[91626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f 1073741824 Jul 13 20:32:37 devstack sudo[91626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Flow 'volume_create_manager' (6ac707b6-839a-4393-9137-89dc305667b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac7259c-b9d6-4dc8-bdd1-c1d019048de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac7259c-b9d6-4dc8-bdd1-c1d019048de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-723077068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a83581-36ce-4387-bc58-1490e72181fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26b8a973679429388f7a842321bb90d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:32:38Z,use_quota=True,user_id='0ac98ecb68724c40a34d6fc5b658cc27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45820fec-d72c-4f66-a5ec-4f30bea3137d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45820fec-d72c-4f66-a5ec-4f30bea3137d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:32:37 devstack sudo[91626]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16855a9-b405-4e55-8a75-148b76016cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16855a9-b405-4e55-8a75-148b76016cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2a83581-36ce-4387-bc58-1490e72181fe', 'volume_name': 'volume-c2a83581-36ce-4387-bc58-1490e72181fe', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6173cd53-302c-4aa2-9bcd-c550cc423091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6173cd53-302c-4aa2-9bcd-c550cc423091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06221ed-68a7-4ea5-a638-a5396535a388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:32:37 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Volume c2a83581-36ce-4387-bc58-1490e72181fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2a83581-36ce-4387-bc58-1490e72181fe', 'volume_size': 1} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f 1073741824" returned: 0 in 0.746s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:37 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f Jul 13 20:32:37 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:38 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f" returned: 0 in 0.399s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:32:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:32:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.446s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:32:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-723077068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a83581-36ce-4387-bc58-1490e72181fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26b8a973679429388f7a842321bb90d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:32:38Z,use_quota=True,user_id='0ac98ecb68724c40a34d6fc5b658cc27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:32:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Creating volume c2a83581-36ce-4387-bc58-1490e72181fe {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:32:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:32:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:32:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:32:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:32:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:32:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:32:38 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:32:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8aabb7-7d65-4c2c-b1f5-ce2741f7d12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:32:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8e5a37-4f2a-4583-9e22-e8d226f31f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:32:38 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe 1073741824 Jul 13 20:32:38 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:38 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Volume volume-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f (89d16d26-1f98-4fe4-a65b-b0a3ba8df01f): created successfully Jul 13 20:32:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8e5a37-4f2a-4583-9e22-e8d226f31f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:32:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Flow 'volume_create_manager' (cb6f8779-44e8-4fb1-8eab-32a77db42753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:32:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-85f69193-851b-409f-8492-7605558df330 tempest-VolumeTypesAccessTest-2005765012 None] Created volume successfully. Jul 13 20:32:38 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe 1073741824" returned: 0 in 0.630s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:38 devstack sudo[91671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe Jul 13 20:32:38 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] Acquiring lock "cinder-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:32:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] Lock "cinder-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:32:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] Acquiring lock "cinder-quobyte-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:32:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] Lock "cinder-quobyte-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:32:39 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe" returned: 0 in 0.427s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:32:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:32:39 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dbf3ef-88ce-4a51-9aa1-a01dc23373ab]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:32:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06221ed-68a7-4ea5-a638-a5396535a388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2a83581-36ce-4387-bc58-1490e72181fe', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:32:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f15083-17dc-453a-acbe-05963b6d115f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:32:39 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Volume volume-c2a83581-36ce-4387-bc58-1490e72181fe (c2a83581-36ce-4387-bc58-1490e72181fe): created successfully Jul 13 20:32:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f15083-17dc-453a-acbe-05963b6d115f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:32:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Flow 'volume_create_manager' (6ac707b6-839a-4393-9137-89dc305667b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:32:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-60b7bcbe-2887-4dfe-811a-a9d8056f9497 tempest-SnapshotMetadataTestJSON-1008981796 None] Created volume successfully. Jul 13 20:32:39 devstack sudo[91677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f Jul 13 20:32:39 devstack sudo[91677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:40 devstack sudo[91677]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f" returned: 0 in 0.739s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:40 devstack sudo[91689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f Jul 13 20:32:40 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0aceff05-c45d-4b0a-ae98-ded140a81313 tempest-SnapshotMetadataTestJSON-1008981796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:32:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0aceff05-c45d-4b0a-ae98-ded140a81313 tempest-SnapshotMetadataTestJSON-1008981796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:32:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0aceff05-c45d-4b0a-ae98-ded140a81313 tempest-SnapshotMetadataTestJSON-1008981796 None] Creating offline snapshot 237dbc5d-f5f4-4a93-bd55-fdd410c650bd of volume c2a83581-36ce-4387-bc58-1490e72181fe {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:32:40 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[68465776-568f-413f-b172-5b995882568f]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:32:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0aceff05-c45d-4b0a-ae98-ded140a81313 tempest-SnapshotMetadataTestJSON-1008981796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:40 devstack sudo[91696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe Jul 13 20:32:40 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:40 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f" returned: 0 in 0.417s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] Lock "cinder-quobyte-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f" released by "delete_volume" :: held 1.251s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:40 devstack cinder-volume[87269]: WARNING cinder.quota [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-58044935 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-58044935, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:32:40 devstack cinder-volume[87269]: WARNING cinder.quota [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-58044935 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-58044935, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:32:40 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] Created reservations ['4d118d69-b1a8-43fa-b67c-bc96c84842eb', 'a4e8c55f-17c8-42e5-9a57-4592222ca406', 'a77997ba-0c81-4727-8010-84f57e78632c', '0f1e59fe-9063-418d-be43-08b267ee9344'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:32:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:32:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:32:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:32:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:32:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:32:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:40 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:32:40 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:41 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0aceff05-c45d-4b0a-ae98-ded140a81313 tempest-SnapshotMetadataTestJSON-1008981796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe" returned: 0 in 0.678s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0aceff05-c45d-4b0a-ae98-ded140a81313 tempest-SnapshotMetadataTestJSON-1008981796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:41 devstack sudo[91713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd 1G Jul 13 20:32:41 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:41 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:41 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:32:41 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] Deleted volume successfully. Jul 13 20:32:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1993ad9c-f4d4-4087-97b5-353bc8cebd29 tempest-VolumeTypesAccessTest-2005765012 None] Lock "cinder-89d16d26-1f98-4fe4-a65b-b0a3ba8df01f-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:41 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0aceff05-c45d-4b0a-ae98-ded140a81313 tempest-SnapshotMetadataTestJSON-1008981796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd 1G" returned: 0 in 0.547s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0aceff05-c45d-4b0a-ae98-ded140a81313 tempest-SnapshotMetadataTestJSON-1008981796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2a83581-36ce-4387-bc58-1490e72181fe -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:41 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2a83581-36ce-4387-bc58-1490e72181fe -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd Jul 13 20:32:41 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:41 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0aceff05-c45d-4b0a-ae98-ded140a81313 tempest-SnapshotMetadataTestJSON-1008981796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2a83581-36ce-4387-bc58-1490e72181fe -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd" returned: 0 in 0.365s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:41 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-0aceff05-c45d-4b0a-ae98-ded140a81313 tempest-SnapshotMetadataTestJSON-1008981796 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd is being set with open permissions: ugo+rw Jul 13 20:32:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0aceff05-c45d-4b0a-ae98-ded140a81313 tempest-SnapshotMetadataTestJSON-1008981796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:41 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd Jul 13 20:32:41 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:42 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0aceff05-c45d-4b0a-ae98-ded140a81313 tempest-SnapshotMetadataTestJSON-1008981796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd" returned: 0 in 0.262s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0aceff05-c45d-4b0a-ae98-ded140a81313 tempest-SnapshotMetadataTestJSON-1008981796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:42 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.info Jul 13 20:32:42 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:42 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0aceff05-c45d-4b0a-ae98-ded140a81313 tempest-SnapshotMetadataTestJSON-1008981796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.info" returned: 0 in 0.404s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:42 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-0aceff05-c45d-4b0a-ae98-ded140a81313 tempest-SnapshotMetadataTestJSON-1008981796 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.info is being set with open permissions: ugo+rw Jul 13 20:32:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0aceff05-c45d-4b0a-ae98-ded140a81313 tempest-SnapshotMetadataTestJSON-1008981796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:42 devstack sudo[91734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.info Jul 13 20:32:42 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:42 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0aceff05-c45d-4b0a-ae98-ded140a81313 tempest-SnapshotMetadataTestJSON-1008981796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.info" returned: 0 in 0.303s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0aceff05-c45d-4b0a-ae98-ded140a81313 tempest-SnapshotMetadataTestJSON-1008981796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.707s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:32:43 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0aceff05-c45d-4b0a-ae98-ded140a81313 tempest-SnapshotMetadataTestJSON-1008981796 None] Create snapshot completed successfully Jul 13 20:32:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] Acquiring lock "cinder-237dbc5d-f5f4-4a93-bd55-fdd410c650bd-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:32:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] Lock "cinder-237dbc5d-f5f4-4a93-bd55-fdd410c650bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:32:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] Acquiring lock "cinder-quobyte-c2a83581-36ce-4387-bc58-1490e72181fe" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:32:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] Lock "cinder-quobyte-c2a83581-36ce-4387-bc58-1490e72181fe" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:32:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] Acquiring lock "cinder-quobyte-237dbc5d-f5f4-4a93-bd55-fdd410c650bd" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:32:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] Lock "cinder-quobyte-237dbc5d-f5f4-4a93-bd55-fdd410c650bd" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:32:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] Deleting offline snapshot 237dbc5d-f5f4-4a93-bd55-fdd410c650bd of volume c2a83581-36ce-4387-bc58-1490e72181fe {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:32:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] snapshot_file for this snap is: volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:32:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc880c6-5be2-473a-8406-3dd068c54936]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:32:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:45 devstack sudo[91803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd Jul 13 20:32:45 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] Acquiring lock "cinder-234237a1-e27e-4d12-a2bb-7e569bd08795-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:32:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] Lock "cinder-234237a1-e27e-4d12-a2bb-7e569bd08795-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:32:45 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd" returned: 0 in 0.934s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2a83581-36ce-4387-bc58-1490e72181fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:32:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] Acquiring lock "cinder-quobyte-234237a1-e27e-4d12-a2bb-7e569bd08795" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:32:46 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0081cf-0cd6-4780-a5cd-0618cf93237b]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:32:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] Lock "cinder-quobyte-234237a1-e27e-4d12-a2bb-7e569bd08795" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:32:46 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfce6e54-2513-4b81-ad62-b22833b50159]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:32:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-234237a1-e27e-4d12-a2bb-7e569bd08795 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:46 devstack sudo[91813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe Jul 13 20:32:46 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:46 devstack sudo[91814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-234237a1-e27e-4d12-a2bb-7e569bd08795 Jul 13 20:32:46 devstack sudo[91814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:46 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe" returned: 0 in 0.688s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:46 devstack sudo[91814]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-234237a1-e27e-4d12-a2bb-7e569bd08795" returned: 0 in 0.657s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-234237a1-e27e-4d12-a2bb-7e569bd08795 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:46 devstack sudo[91823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd Jul 13 20:32:46 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:46 devstack sudo[91824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-234237a1-e27e-4d12-a2bb-7e569bd08795 Jul 13 20:32:46 devstack sudo[91824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:47 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:47 devstack sudo[91824]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd" returned: 0 in 0.564s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-234237a1-e27e-4d12-a2bb-7e569bd08795" returned: 0 in 0.566s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:47 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd Jul 13 20:32:47 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] Lock "cinder-quobyte-234237a1-e27e-4d12-a2bb-7e569bd08795" released by "delete_volume" :: held 1.306s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:47 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] Created reservations ['458447fd-62b9-42d1-a1e7-e53ae4dd416f', '2e8c4ca5-8d5d-4b24-aee8-68929b4ebd3d', '6a8e6953-782e-4a6a-96d2-ce6ad53f1c75', 'd97f4ae9-7b64-4e9e-8c0d-bc571da85976'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:32:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:32:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:32:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:32:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:32:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:32:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:47 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe.237dbc5d-f5f4-4a93-bd55-fdd410c650bd" returned: 0 in 0.380s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:47 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:32:47 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] Lock "cinder-quobyte-237dbc5d-f5f4-4a93-bd55-fdd410c650bd" released by "_delete_snapshot" :: held 2.797s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] Lock "cinder-quobyte-c2a83581-36ce-4387-bc58-1490e72181fe" released by "delete_snapshot" :: held 2.841s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:47 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] Created reservations ['72d33743-31c3-4b9d-818d-93f177a573d3', '0a430d25-5fd8-48ce-84bd-e8f9476295f0', '86e28a5c-8321-4eb4-b2a2-eaabd7df8cab', 'b83bdf47-7a97-4bf8-9e39-79028a9cd18a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:32:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] Delete snapshot completed successfully. Jul 13 20:32:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e4e36415-216b-47f1-ad7e-7b3960dfbf98 tempest-SnapshotMetadataTestJSON-1008981796 None] Lock "cinder-237dbc5d-f5f4-4a93-bd55-fdd410c650bd-delete_snapshot" released by "delete_snapshot" :: held 3.097s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:48 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.356s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:48 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:32:48 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] Deleted volume successfully. Jul 13 20:32:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f1cc144-1025-44d0-a073-6be5f4ee9412 tempest-TaggedAttachmentsTest-1415945618 None] Lock "cinder-234237a1-e27e-4d12-a2bb-7e569bd08795-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] Acquiring lock "cinder-c2a83581-36ce-4387-bc58-1490e72181fe-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:32:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] Lock "cinder-c2a83581-36ce-4387-bc58-1490e72181fe-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:32:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] Acquiring lock "cinder-quobyte-c2a83581-36ce-4387-bc58-1490e72181fe" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:32:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] Lock "cinder-quobyte-c2a83581-36ce-4387-bc58-1490e72181fe" acquired by "delete_volume" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:32:48 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[978c4d05-c49c-4411-99d9-d51153b340c3]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:32:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:48 devstack sudo[91843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe Jul 13 20:32:48 devstack sudo[91843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:49 devstack sudo[91843]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe" returned: 0 in 0.684s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:49 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe Jul 13 20:32:49 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:49 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2a83581-36ce-4387-bc58-1490e72181fe" returned: 0 in 0.445s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] Lock "cinder-quobyte-c2a83581-36ce-4387-bc58-1490e72181fe" released by "delete_volume" :: held 1.252s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:49 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] Created reservations ['da9c0814-13ed-4ba2-87b2-c7c1926e1981', '2614256a-3c48-4779-a589-d0982cee598a', 'c4e6f7ef-c512-4b36-995e-b0dd59cd14fb', 'b3fe4dfd-b425-4958-8fbf-4e141dfb007c'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:32:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:32:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:32:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:32:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:32:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:32:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:32:49 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:32:49 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:32:50 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Jul 13 20:32:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.501s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:32:50 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:32:50 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] Deleted volume successfully. Jul 13 20:32:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8a0366ad-07a3-4b10-b4dc-0095520a1733 tempest-SnapshotMetadataTestJSON-1008981796 None] Lock "cinder-c2a83581-36ce-4387-bc58-1490e72181fe-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:32:59 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=35,cinder:UPDATE=37,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Flow 'volume_create_manager' (3ef35fb5-a1c7-4583-a5a7-a2054e83b72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8af929-6176-494e-aece-042a36ec6e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8af929-6176-494e-aece-042a36ec6e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-708080975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b03285c35234805848457fb8ea7a0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:33:00Z,use_quota=True,user_id='eddb833f059048c6b067381e767bb7d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0715ab-eefe-47cb-a726-f9ec966b74a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0715ab-eefe-47cb-a726-f9ec966b74a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92360706-904b-4e54-8ac2-18782df4e92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92360706-904b-4e54-8ac2-18782df4e92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9', 'volume_name': 'volume-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a702af4-9b00-4c48-b2ec-8d8a1c1aa568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a702af4-9b00-4c48-b2ec-8d8a1c1aa568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e1af24-ecff-4810-9bde-c7021c0adfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:00 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Volume a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9', 'volume_size': 1} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-708080975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b03285c35234805848457fb8ea7a0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:33:00Z,use_quota=True,user_id='eddb833f059048c6b067381e767bb7d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Creating volume a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:33:00 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:00 devstack sudo[91951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9 1073741824 Jul 13 20:33:00 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Flow 'volume_create_manager' (0302daf5-dd39-4ea1-afd1-a843096e1376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebf62f2-7fd2-40ef-9807-fea69492dc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebf62f2-7fd2-40ef-9807-fea69492dc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1479402761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c10be454-cd76-4ade-b1f0-bca1e8c2903d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1ea88b5a7448caa302f2a1bfff0d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:33:00Z,use_quota=True,user_id='fdf53669d99f4e238135469574395b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e5c64e-16bb-4e3a-a875-ded6e4b56e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e5c64e-16bb-4e3a-a875-ded6e4b56e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27e3fcc-1887-4c91-aeff-e3f70fda84e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:00 devstack cinder-volume[87269]: DEBUG cinder.image.glance [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Creating Keystone auth plugin from conf {{(pid=87269) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 13 20:33:01 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9 1073741824" returned: 0 in 1.027s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27e3fcc-1887-4c91-aeff-e3f70fda84e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c10be454-cd76-4ade-b1f0-bca1e8c2903d', 'volume_name': 'volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d', 'volume_size': 1, 'image_id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6b4015e3a3db4a91ba2712f5d9c0002b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'created_at': datetime.datetime(2026, 7, 13, 18, 22, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5c85faa-ccd2-446c-ac1c-c871b5183834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d41738a-1723-4dad-a5ca-7fd4b317a2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d41738a-1723-4dad-a5ca-7fd4b317a2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16966895-c50f-489a-b2c1-506e7a481fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:01 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Volume c10be454-cd76-4ade-b1f0-bca1e8c2903d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d', 'volume_size': 1, 'image_id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6b4015e3a3db4a91ba2712f5d9c0002b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'created_at': datetime.datetime(2026, 7, 13, 18, 22, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5c85faa-ccd2-446c-ac1c-c871b5183834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 13 20:33:01 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Trying to clone c10be454-cd76-4ade-b1f0-bca1e8c2903d from image a5c85faa-ccd2-446c-ac1c-c871b5183834 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}]). {{(pid=87269) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 13 20:33:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:01 devstack sudo[91980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9 Jul 13 20:33:01 devstack sudo[91980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:02 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_76gr4lqmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 13 20:33:02 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Image download 20.69 MB at 20.69 MB/s Jul 13 20:33:02 devstack sudo[91980]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9" returned: 0 in 0.571s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:33:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e1af24-ecff-4810-9bde-c7021c0adfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84d4ae0-0d4a-41ad-9f9c-7e4cb98fe3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:02 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c41abed-c778-42f3-82b4-6677d39d2b53]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_76gr4lqmdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:02 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Volume volume-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9 (a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9): created successfully Jul 13 20:33:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84d4ae0-0d4a-41ad-9f9c-7e4cb98fe3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Flow 'volume_create_manager' (3ef35fb5-a1c7-4583-a5a7-a2054e83b72b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-abce3b5d-d6e3-418c-9066-25d3b2e61f73 tempest-AbsoluteLimitsTests-2129409160 None] Created volume successfully. Jul 13 20:33:02 devstack sudo[92009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_76gr4lqmdevstack@QuobyteHD Jul 13 20:33:02 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:02 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_76gr4lqmdevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:02 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Temporary image a5c85faa-ccd2-446c-ac1c-c871b5183834 is fetched for user fdf53669d99f4e238135469574395b10. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 13 20:33:02 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0884ad25-4989-4c2a-95b6-bdb8e328c387]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_76gr4lqmdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:03 devstack sudo[92016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_76gr4lqmdevstack@QuobyteHD Jul 13 20:33:03 devstack sudo[92016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:03 devstack sudo[92016]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_76gr4lqmdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1479402761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c10be454-cd76-4ade-b1f0-bca1e8c2903d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1ea88b5a7448caa302f2a1bfff0d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:33:00Z,use_quota=True,user_id='fdf53669d99f4e238135469574395b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:33:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Creating volume c10be454-cd76-4ade-b1f0-bca1e8c2903d {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:33:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:33:03 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:33:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:03 devstack sudo[92021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d 1073741824 Jul 13 20:33:03 devstack sudo[92021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] Acquiring lock "cinder-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] Lock "cinder-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] Acquiring lock "cinder-quobyte-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] Lock "cinder-quobyte-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:03 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc486924-d5b5-446c-ae18-9912d14c3dff]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:03 devstack sudo[92027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9 Jul 13 20:33:03 devstack sudo[92027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:03 devstack sudo[92021]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d 1073741824" returned: 0 in 0.657s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:04 devstack sudo[92029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d Jul 13 20:33:04 devstack sudo[92029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:04 devstack sudo[92027]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9" returned: 0 in 0.475s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:04 devstack sudo[92035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9 Jul 13 20:33:04 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:04 devstack sudo[92029]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d" returned: 0 in 0.396s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:33:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:04 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Attempting download of a5c85faa-ccd2-446c-ac1c-c871b5183834 ((None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}])) to volume c10be454-cd76-4ade-b1f0-bca1e8c2903d. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 13 20:33:04 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[610ac9fd-45e7-4934-a6c0-4c76976e0d43]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_913n92qp {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:04 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9" returned: 0 in 0.446s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] Lock "cinder-quobyte-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9" released by "delete_volume" :: held 0.993s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:04 devstack sudo[92039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_913n92qp Jul 13 20:33:04 devstack sudo[92039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:04 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] Created reservations ['41e4f150-f3b3-46b8-ad26-2ca05965eaa1', '37f8ca17-7840-479c-ba0d-7ba3481bdb6a', 'c2ae9167-121b-47bc-b776-5c71d16ba48d', '2864719f-ec94-408b-8d0b-d78c2aab63a7'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:33:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:04 devstack sudo[92041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:33:04 devstack sudo[92041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:05 devstack sudo[92039]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_913n92qp" returned: 0 in 0.665s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_913n92qp {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:33:05 devstack sudo[92041]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Flow 'volume_create_manager' (041dd8d6-d7de-4e8c-8b9f-a1cebaaf2f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45ee35f-3ac7-4f65-bacb-0803f65082f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.388s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:33:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] Deleted volume successfully. Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45ee35f-3ac7-4f65-bacb-0803f65082f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-204438459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0323bd4-54ee-40a6-9c56-ef3f220fc94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41440bf6aa8a4731893ae7c24a789b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:33:05Z,use_quota=True,user_id='44ba73a141a542e6becc1dcc9e898ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca4ba5a-4250-46ac-bac5-c62ea99e735f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca4ba5a-4250-46ac-bac5-c62ea99e735f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c349e069-5fd2-47e8-9176-9bef9a0ffc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c349e069-5fd2-47e8-9176-9bef9a0ffc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0323bd4-54ee-40a6-9c56-ef3f220fc94d', 'volume_name': 'volume-b0323bd4-54ee-40a6-9c56-ef3f220fc94d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b533fa3-1fef-462a-8fb5-88df58652298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b533fa3-1fef-462a-8fb5-88df58652298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:05 devstack sudo[92046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_913n92qp Jul 13 20:33:05 devstack sudo[92046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ff1a01-e38d-434f-a31b-a15e5ef98a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Volume b0323bd4-54ee-40a6-9c56-ef3f220fc94d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0323bd4-54ee-40a6-9c56-ef3f220fc94d', 'volume_size': 1} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-204438459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0323bd4-54ee-40a6-9c56-ef3f220fc94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41440bf6aa8a4731893ae7c24a789b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:33:05Z,use_quota=True,user_id='44ba73a141a542e6becc1dcc9e898ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Creating volume b0323bd4-54ee-40a6-9c56-ef3f220fc94d {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:33:05 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b0323bd4-54ee-40a6-9c56-ef3f220fc94d 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:05 devstack sudo[92048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b0323bd4-54ee-40a6-9c56-ef3f220fc94d 1073741824 Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-434fe01e-7398-47c0-8551-9d5e8efefe20 tempest-AbsoluteLimitsTests-2129409160 None] Lock "cinder-a3e39a86-e5f7-4203-b17e-2bc1a2ec55f9-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:05 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:05 devstack sudo[92046]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_913n92qp" returned: 1 in 0.424s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_913n92qp' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb04f65-ead7-4d52-8c5b-4a62e48cea80]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_76gr4lqmdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:05 devstack sudo[92054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_76gr4lqmdevstack@QuobyteHD Jul 13 20:33:05 devstack sudo[92054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:05 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b0323bd4-54ee-40a6-9c56-ef3f220fc94d 1073741824" returned: 0 in 0.608s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:06 devstack sudo[92054]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b0323bd4-54ee-40a6-9c56-ef3f220fc94d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_76gr4lqmdevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:06 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] a5c85faa-ccd2-446c-ac1c-c871b5183834 was qcow2, converting to raw {{(pid=87269) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 13 20:33:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_76gr4lqmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:06 devstack sudo[92062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b0323bd4-54ee-40a6-9c56-ef3f220fc94d Jul 13 20:33:06 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:06 devstack sudo[92063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_76gr4lqmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d Jul 13 20:33:06 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:06 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b0323bd4-54ee-40a6-9c56-ef3f220fc94d" returned: 0 in 0.321s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:33:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ff1a01-e38d-434f-a31b-a15e5ef98a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0323bd4-54ee-40a6-9c56-ef3f220fc94d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db79db24-65f9-4b3f-82b6-abe04e6db067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:06 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Volume volume-b0323bd4-54ee-40a6-9c56-ef3f220fc94d (b0323bd4-54ee-40a6-9c56-ef3f220fc94d): created successfully Jul 13 20:33:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db79db24-65f9-4b3f-82b6-abe04e6db067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Flow 'volume_create_manager' (041dd8d6-d7de-4e8c-8b9f-a1cebaaf2f59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2f88cd6d-51d5-4240-8fd6-1efe86f54d6a tempest-ServersNegativeTestJSON-1562242241 None] Created volume successfully. Jul 13 20:33:08 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_76gr4lqmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d" returned: 0 in 2.028s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:08 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_76gr4lqmdevstack@QuobyteHD, size 112.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:33:08 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Converted 112.00 MB image at 55.21 MB/s Jul 13 20:33:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:08 devstack sudo[92072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d 1G Jul 13 20:33:08 devstack sudo[92072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:08 devstack sudo[92072]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d 1G" returned: 0 in 0.353s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:08 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d147887-bc46-4b25-a313-17b213e47fe1]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:08 devstack sudo[92077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d Jul 13 20:33:08 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:09 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d" returned: 0 in 0.465s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:09 devstack sudo[92081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d Jul 13 20:33:09 devstack sudo[92081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:09 devstack sudo[92081]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d" returned: 1 in 0.436s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Downloaded image a5c85faa-ccd2-446c-ac1c-c871b5183834 ((None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}])) to volume c10be454-cd76-4ade-b1f0-bca1e8c2903d successfully. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Temporary image a5c85faa-ccd2-446c-ac1c-c871b5183834 for user fdf53669d99f4e238135469574395b10 is deleted. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Marking volume c10be454-cd76-4ade-b1f0-bca1e8c2903d as bootable. {{(pid=87269) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Copying metadata from image a5c85faa-ccd2-446c-ac1c-c871b5183834 to c10be454-cd76-4ade-b1f0-bca1e8c2903d. {{(pid=87269) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Creating volume glance metadata for volume c10be454-cd76-4ade-b1f0-bca1e8c2903d backed by image a5c85faa-ccd2-446c-ac1c-c871b5183834 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87269) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16966895-c50f-489a-b2c1-506e7a481fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d', 'volume_size': 1, 'image_id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6b4015e3a3db4a91ba2712f5d9c0002b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'created_at': datetime.datetime(2026, 7, 13, 18, 22, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5c85faa-ccd2-446c-ac1c-c871b5183834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b5ac7b-558d-4e49-8863-e2268754924b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:09 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Volume volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d (c10be454-cd76-4ade-b1f0-bca1e8c2903d): created successfully Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b5ac7b-558d-4e49-8863-e2268754924b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Flow 'volume_create_manager' (0302daf5-dd39-4ea1-afd1-a843096e1376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-13cf221f-cf06-4fec-9eb1-466632e442b0 tempest-VolumesImageMetadata-1402148119 None] Created volume successfully. Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Flow 'volume_create_manager' (f800c492-3643-4816-b698-2ee638cc5fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c903eb3-69af-4e01-bef2-055ceaa854bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c903eb3-69af-4e01-bef2-055ceaa854bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1164781399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c4c31c-4880-4a17-bd8d-152ed3ad35ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41440bf6aa8a4731893ae7c24a789b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:33:10Z,use_quota=True,user_id='44ba73a141a542e6becc1dcc9e898ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66130e86-c6df-4518-af11-e05b77cecf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66130e86-c6df-4518-af11-e05b77cecf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9218ab2e-eea9-416b-ac91-72f3f2794fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9218ab2e-eea9-416b-ac91-72f3f2794fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90c4c31c-4880-4a17-bd8d-152ed3ad35ac', 'volume_name': 'volume-90c4c31c-4880-4a17-bd8d-152ed3ad35ac', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46034abf-62a5-40df-be3c-c6f0904c599e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46034abf-62a5-40df-be3c-c6f0904c599e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f81ae77-e63a-4f6b-8fba-7ea242e7ca26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:10 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Volume 90c4c31c-4880-4a17-bd8d-152ed3ad35ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90c4c31c-4880-4a17-bd8d-152ed3ad35ac', 'volume_size': 1} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1164781399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c4c31c-4880-4a17-bd8d-152ed3ad35ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41440bf6aa8a4731893ae7c24a789b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:33:10Z,use_quota=True,user_id='44ba73a141a542e6becc1dcc9e898ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Creating volume 90c4c31c-4880-4a17-bd8d-152ed3ad35ac {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:33:10 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90c4c31c-4880-4a17-bd8d-152ed3ad35ac 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:10 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90c4c31c-4880-4a17-bd8d-152ed3ad35ac 1073741824 Jul 13 20:33:10 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] Acquiring lock "cinder-c10be454-cd76-4ade-b1f0-bca1e8c2903d-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] Lock "cinder-c10be454-cd76-4ade-b1f0-bca1e8c2903d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] Acquiring lock "cinder-quobyte-c10be454-cd76-4ade-b1f0-bca1e8c2903d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:10 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90c4c31c-4880-4a17-bd8d-152ed3ad35ac 1073741824" returned: 0 in 0.625s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] Lock "cinder-quobyte-c10be454-cd76-4ade-b1f0-bca1e8c2903d" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90c4c31c-4880-4a17-bd8d-152ed3ad35ac {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[655bfa2a-f372-4dd6-8b3b-86e93e64f15b]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:10 devstack sudo[92092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90c4c31c-4880-4a17-bd8d-152ed3ad35ac Jul 13 20:33:10 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:10 devstack sudo[92093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d Jul 13 20:33:10 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:11 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90c4c31c-4880-4a17-bd8d-152ed3ad35ac" returned: 0 in 0.322s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f81ae77-e63a-4f6b-8fba-7ea242e7ca26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c4c31c-4880-4a17-bd8d-152ed3ad35ac', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342bdfe8-a3f3-47b3-a85b-536122d4aec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:11 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Volume volume-90c4c31c-4880-4a17-bd8d-152ed3ad35ac (90c4c31c-4880-4a17-bd8d-152ed3ad35ac): created successfully Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342bdfe8-a3f3-47b3-a85b-536122d4aec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Flow 'volume_create_manager' (f800c492-3643-4816-b698-2ee638cc5fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-691c7b2e-a847-4169-9caa-79d8ebea4e91 tempest-ServersNegativeTestJSON-1562242241 None] Created volume successfully. Jul 13 20:33:11 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d" returned: 0 in 0.445s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:11 devstack sudo[92099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d Jul 13 20:33:11 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:11 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d" returned: 1 in 0.450s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:11 devstack sudo[92104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d Jul 13 20:33:11 devstack sudo[92104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Flow 'volume_create_manager' (9429304f-3b48-4188-ab9b-f58d16353052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e263a8e-9e3d-4c6f-9ec2-92e4ebe55f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e263a8e-9e3d-4c6f-9ec2-92e4ebe55f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-738145866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe38c9e-493a-4ccb-a85d-8cf6486bed55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fa8e28f5634435b27d83ea5c418e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:33:12Z,use_quota=True,user_id='a9339b73981644c0a9429a6e574ca85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834c1af1-64f1-4afe-a07d-4fdc37d84f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834c1af1-64f1-4afe-a07d-4fdc37d84f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca65f11-b14d-4c01-aaae-c5a81076c513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca65f11-b14d-4c01-aaae-c5a81076c513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfe38c9e-493a-4ccb-a85d-8cf6486bed55', 'volume_name': 'volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d9ca39-2159-419b-bd0d-aacfd9168d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d9ca39-2159-419b-bd0d-aacfd9168d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07db0c03-09c2-425e-b6b2-77d970832958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:11 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Volume dfe38c9e-493a-4ccb-a85d-8cf6486bed55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55', 'volume_size': 1} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-738145866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe38c9e-493a-4ccb-a85d-8cf6486bed55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fa8e28f5634435b27d83ea5c418e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:33:12Z,use_quota=True,user_id='a9339b73981644c0a9429a6e574ca85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Creating volume dfe38c9e-493a-4ccb-a85d-8cf6486bed55 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:33:11 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:11 devstack sudo[92104]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c10be454-cd76-4ade-b1f0-bca1e8c2903d" returned: 0 in 0.259s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:11 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55 1073741824 Jul 13 20:33:11 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] Lock "cinder-quobyte-c10be454-cd76-4ade-b1f0-bca1e8c2903d" released by "delete_volume" :: held 1.233s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:11 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] Created reservations ['b5c0ec1b-8eba-49e0-9889-1888720ab38c', 'f51760b1-b191-4df3-93a9-920255be1d25', '6b5411e5-198a-4986-952e-4edcd4c5020d', '98c72fda-49ee-46a1-933d-33280861ddcf'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:12 devstack sudo[92109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:33:12 devstack sudo[92109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:12 devstack sudo[92109]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.264s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:33:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] Deleted volume successfully. Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-afb05d99-5b49-46c4-9d0f-61bf0d69d304 tempest-VolumesImageMetadata-1402148119 None] Lock "cinder-c10be454-cd76-4ade-b1f0-bca1e8c2903d-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:12 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55 1073741824" returned: 0 in 0.481s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:12 devstack sudo[92117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55 Jul 13 20:33:12 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] Acquiring lock "cinder-90c4c31c-4880-4a17-bd8d-152ed3ad35ac-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] Lock "cinder-90c4c31c-4880-4a17-bd8d-152ed3ad35ac-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] Acquiring lock "cinder-quobyte-90c4c31c-4880-4a17-bd8d-152ed3ad35ac" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] Lock "cinder-quobyte-90c4c31c-4880-4a17-bd8d-152ed3ad35ac" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4e30fc-6f37-42d7-9032-c323b7ad9968]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90c4c31c-4880-4a17-bd8d-152ed3ad35ac {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:12 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55" returned: 0 in 0.309s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07db0c03-09c2-425e-b6b2-77d970832958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c84f2ac-c4be-4bef-bede-7d1bbd2389a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:12 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Volume volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55 (dfe38c9e-493a-4ccb-a85d-8cf6486bed55): created successfully Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c84f2ac-c4be-4bef-bede-7d1bbd2389a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:12 devstack sudo[92120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90c4c31c-4880-4a17-bd8d-152ed3ad35ac Jul 13 20:33:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Flow 'volume_create_manager' (9429304f-3b48-4188-ab9b-f58d16353052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:12 devstack sudo[92120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1350174a-5a9e-4997-a055-b3148126af2d tempest-VolumesDeleteCascade-980587823 None] Created volume successfully. Jul 13 20:33:13 devstack sudo[92120]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90c4c31c-4880-4a17-bd8d-152ed3ad35ac" returned: 0 in 0.494s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90c4c31c-4880-4a17-bd8d-152ed3ad35ac {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:13 devstack sudo[92126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90c4c31c-4880-4a17-bd8d-152ed3ad35ac Jul 13 20:33:13 devstack sudo[92126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:13 devstack sudo[92126]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90c4c31c-4880-4a17-bd8d-152ed3ad35ac" returned: 0 in 0.309s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] Lock "cinder-quobyte-90c4c31c-4880-4a17-bd8d-152ed3ad35ac" released by "delete_volume" :: held 0.856s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:13 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] Created reservations ['1b72b35c-87bd-4a7c-8bef-a4a849175a9d', '763202b8-268c-4ad7-8c4d-ba753559b694', 'd2d7cabe-54fc-4b78-ad3c-e98714cbde14', 'b8bf6136-3791-46ed-8823-f8623b7d5f10'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:33:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:13 devstack sudo[92129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:33:13 devstack sudo[92129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] Acquiring lock "cinder-b0323bd4-54ee-40a6-9c56-ef3f220fc94d-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] Lock "cinder-b0323bd4-54ee-40a6-9c56-ef3f220fc94d-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] Acquiring lock "cinder-quobyte-b0323bd4-54ee-40a6-9c56-ef3f220fc94d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] Lock "cinder-quobyte-b0323bd4-54ee-40a6-9c56-ef3f220fc94d" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:13 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1c8fb4-cb3d-4b82-8019-cb4cbc1d5a60]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b0323bd4-54ee-40a6-9c56-ef3f220fc94d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:14 devstack sudo[92129]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.423s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:14 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:33:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] Deleted volume successfully. Jul 13 20:33:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-78035187-8bab-4885-8d70-171d49c953ff tempest-ServersNegativeTestJSON-1562242241 None] Lock "cinder-90c4c31c-4880-4a17-bd8d-152ed3ad35ac-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:14 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b0323bd4-54ee-40a6-9c56-ef3f220fc94d Jul 13 20:33:14 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9efda805-e9b4-40ac-9f60-992911df0c88 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9efda805-e9b4-40ac-9f60-992911df0c88 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9efda805-e9b4-40ac-9f60-992911df0c88 tempest-VolumesDeleteCascade-980587823 None] Creating offline snapshot 7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 of volume dfe38c9e-493a-4ccb-a85d-8cf6486bed55 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:33:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[24498117-e673-40cf-a988-e657c7a1ca21]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9efda805-e9b4-40ac-9f60-992911df0c88 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:14 devstack sudo[92134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55 Jul 13 20:33:14 devstack sudo[92134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:14 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b0323bd4-54ee-40a6-9c56-ef3f220fc94d" returned: 0 in 0.556s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b0323bd4-54ee-40a6-9c56-ef3f220fc94d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:14 devstack sudo[92139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b0323bd4-54ee-40a6-9c56-ef3f220fc94d Jul 13 20:33:14 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:14 devstack sudo[92134]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9efda805-e9b4-40ac-9f60-992911df0c88 tempest-VolumesDeleteCascade-980587823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55" returned: 0 in 0.509s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9efda805-e9b4-40ac-9f60-992911df0c88 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:14 devstack sudo[92144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 1G Jul 13 20:33:14 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:14 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b0323bd4-54ee-40a6-9c56-ef3f220fc94d" returned: 0 in 0.352s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] Lock "cinder-quobyte-b0323bd4-54ee-40a6-9c56-ef3f220fc94d" released by "delete_volume" :: held 0.996s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:14 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] Created reservations ['bc04c092-f641-4a6a-b381-1207d47050bd', 'c51618e2-7f4e-4946-97b3-007d212577f5', '4b16dd9f-a335-4476-9591-8f6503d79a5e', 'f99961b6-ffdd-4027-90b2-57d5479e1f37'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:33:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:15 devstack sudo[92149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:33:15 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:15 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9efda805-e9b4-40ac-9f60-992911df0c88 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 1G" returned: 0 in 0.560s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9efda805-e9b4-40ac-9f60-992911df0c88 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:15 devstack sudo[92153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 Jul 13 20:33:15 devstack sudo[92153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:15 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.307s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:15 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:33:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] Deleted volume successfully. Jul 13 20:33:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-22f86352-4202-42cb-9bb3-d7df30249ae2 tempest-ServersNegativeTestJSON-1562242241 None] Lock "cinder-b0323bd4-54ee-40a6-9c56-ef3f220fc94d-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:15 devstack sudo[92153]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9efda805-e9b4-40ac-9f60-992911df0c88 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0" returned: 0 in 0.406s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:15 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-9efda805-e9b4-40ac-9f60-992911df0c88 tempest-VolumesDeleteCascade-980587823 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 is being set with open permissions: ugo+rw Jul 13 20:33:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9efda805-e9b4-40ac-9f60-992911df0c88 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:15 devstack sudo[92161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 Jul 13 20:33:15 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:16 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9efda805-e9b4-40ac-9f60-992911df0c88 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0" returned: 0 in 0.304s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9efda805-e9b4-40ac-9f60-992911df0c88 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:16 devstack sudo[92164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.info Jul 13 20:33:16 devstack sudo[92164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:16 devstack sudo[92164]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9efda805-e9b4-40ac-9f60-992911df0c88 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.info" returned: 0 in 0.435s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:16 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-9efda805-e9b4-40ac-9f60-992911df0c88 tempest-VolumesDeleteCascade-980587823 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.info is being set with open permissions: ugo+rw Jul 13 20:33:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9efda805-e9b4-40ac-9f60-992911df0c88 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:16 devstack sudo[92169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.info Jul 13 20:33:16 devstack sudo[92169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:16 devstack sudo[92169]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9efda805-e9b4-40ac-9f60-992911df0c88 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.info" returned: 0 in 0.418s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9efda805-e9b4-40ac-9f60-992911df0c88 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.771s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9efda805-e9b4-40ac-9f60-992911df0c88 tempest-VolumesDeleteCascade-980587823 None] Create snapshot completed successfully Jul 13 20:33:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-be85ba84-daed-4917-97cc-f747d7d3d5b7 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-be85ba84-daed-4917-97cc-f747d7d3d5b7 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-be85ba84-daed-4917-97cc-f747d7d3d5b7 tempest-VolumesDeleteCascade-980587823 None] Creating offline snapshot 1df4dfdc-0fe5-489a-85c6-efa8a29643ad of volume dfe38c9e-493a-4ccb-a85d-8cf6486bed55 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:33:17 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[faca05e1-adb5-490d-a866-f769810ad42b]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-be85ba84-daed-4917-97cc-f747d7d3d5b7 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:17 devstack sudo[92193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 Jul 13 20:33:17 devstack sudo[92193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:18 devstack sudo[92193]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-be85ba84-daed-4917-97cc-f747d7d3d5b7 tempest-VolumesDeleteCascade-980587823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0" returned: 0 in 0.448s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-be85ba84-daed-4917-97cc-f747d7d3d5b7 tempest-VolumesDeleteCascade-980587823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:33:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-be85ba84-daed-4917-97cc-f747d7d3d5b7 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:18 devstack sudo[92200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad 1G Jul 13 20:33:18 devstack sudo[92200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:18 devstack sudo[92200]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-be85ba84-daed-4917-97cc-f747d7d3d5b7 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad 1G" returned: 0 in 0.536s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-be85ba84-daed-4917-97cc-f747d7d3d5b7 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:18 devstack sudo[92206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad Jul 13 20:33:18 devstack sudo[92206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:33:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:18 devstack sudo[92209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:33:18 devstack sudo[92209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:19 devstack sudo[92206]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-be85ba84-daed-4917-97cc-f747d7d3d5b7 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad" returned: 0 in 0.422s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:19 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-be85ba84-daed-4917-97cc-f747d7d3d5b7 tempest-VolumesDeleteCascade-980587823 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad is being set with open permissions: ugo+rw Jul 13 20:33:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-be85ba84-daed-4917-97cc-f747d7d3d5b7 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:19 devstack sudo[92209]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.346s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:33:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:33:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:33:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:33:19 devstack sudo[92216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad Jul 13 20:33:19 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:19 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-be85ba84-daed-4917-97cc-f747d7d3d5b7 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad" returned: 0 in 0.300s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:19 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=75,cinder:UPDATE=92,cinder:DELETE=10,cinder:INSERT=31 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:33:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-be85ba84-daed-4917-97cc-f747d7d3d5b7 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.858s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-be85ba84-daed-4917-97cc-f747d7d3d5b7 tempest-VolumesDeleteCascade-980587823 None] Create snapshot completed successfully Jul 13 20:33:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "cinder-dfe38c9e-493a-4ccb-a85d-8cf6486bed55-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-dfe38c9e-493a-4ccb-a85d-8cf6486bed55-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Performing cascade delete. {{(pid=87269) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 13 20:33:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "cinder-1df4dfdc-0fe5-489a-85c6-efa8a29643ad-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-1df4dfdc-0fe5-489a-85c6-efa8a29643ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "cinder-quobyte-dfe38c9e-493a-4ccb-a85d-8cf6486bed55" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-dfe38c9e-493a-4ccb-a85d-8cf6486bed55" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "cinder-quobyte-1df4dfdc-0fe5-489a-85c6-efa8a29643ad" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-1df4dfdc-0fe5-489a-85c6-efa8a29643ad" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Deleting offline snapshot 1df4dfdc-0fe5-489a-85c6-efa8a29643ad of volume dfe38c9e-493a-4ccb-a85d-8cf6486bed55 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:33:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] snapshot_file for this snap is: volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:33:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[824b8bbe-0051-4cd5-9d60-7a8616fcd80c]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:20 devstack sudo[92222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad Jul 13 20:33:20 devstack sudo[92222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:20 devstack sudo[92222]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad" returned: 0 in 0.506s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:33:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e4d76e-0dca-4547-a991-8eb3283772da]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:20 devstack sudo[92228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 Jul 13 20:33:20 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:21 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0" returned: 0 in 0.499s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:33:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:21 devstack sudo[92233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad Jul 13 20:33:21 devstack sudo[92233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:21 devstack sudo[92233]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad" returned: 0 in 0.425s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:21 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad Jul 13 20:33:21 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:21 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.1df4dfdc-0fe5-489a-85c6-efa8a29643ad" returned: 0 in 0.312s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-1df4dfdc-0fe5-489a-85c6-efa8a29643ad" released by "_delete_snapshot" :: held 1.874s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-dfe38c9e-493a-4ccb-a85d-8cf6486bed55" released by "delete_snapshot" :: held 1.899s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:22 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Created reservations ['1a9d1d36-e8ff-4fba-9bc2-8bf193e414bd', '44d61b08-413c-42b4-a63e-8c9167e7764c', 'd0f7c7de-b7b9-49f2-9035-b22fd38be0ba', '8e4fbd1d-60ed-45b8-8a85-29b811684916'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:33:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Delete snapshot completed successfully. Jul 13 20:33:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-1df4dfdc-0fe5-489a-85c6-efa8a29643ad-delete_snapshot" released by "delete_snapshot" :: held 2.071s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "cinder-7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "cinder-quobyte-dfe38c9e-493a-4ccb-a85d-8cf6486bed55" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-dfe38c9e-493a-4ccb-a85d-8cf6486bed55" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "cinder-quobyte-7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Deleting offline snapshot 7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 of volume dfe38c9e-493a-4ccb-a85d-8cf6486bed55 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:33:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] snapshot_file for this snap is: volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:33:22 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eae351c-0f11-43a4-80ec-91ea82896863]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:22 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 Jul 13 20:33:22 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:22 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0" returned: 0 in 0.476s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:33:22 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9303738-96c7-4226-9084-10f5102a269e]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:22 devstack sudo[92248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55 Jul 13 20:33:22 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:23 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55" returned: 0 in 0.459s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:23 devstack sudo[92254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 Jul 13 20:33:23 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:23 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0" returned: 0 in 0.400s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:23 devstack sudo[92260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0 Jul 13 20:33:23 devstack sudo[92260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:23 devstack sudo[92260]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55.7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0" returned: 0 in 0.275s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0" released by "_delete_snapshot" :: held 1.734s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-dfe38c9e-493a-4ccb-a85d-8cf6486bed55" released by "delete_snapshot" :: held 1.762s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:24 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Created reservations ['9eec8ef1-5c1e-4e88-9f5e-10aa00dc85cd', '7d610b73-c022-4c0f-988b-163d6f782f5b', '7f16f3dd-7a6f-478d-980b-5c225f98de17', '157cf5f2-324c-4a67-86b9-80c2d859de82'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:33:24 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Delete snapshot completed successfully. Jul 13 20:33:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-7e4789f0-3e47-4ccf-85ea-67cd9f8bd2f0-delete_snapshot" released by "delete_snapshot" :: held 1.973s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Snapshots deleted, issuing volume delete {{(pid=87269) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 13 20:33:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "cinder-quobyte-dfe38c9e-493a-4ccb-a85d-8cf6486bed55" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-dfe38c9e-493a-4ccb-a85d-8cf6486bed55" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b9a255-c61c-4963-86c8-ce6f6c051f1a]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:24 devstack sudo[92263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55 Jul 13 20:33:24 devstack sudo[92263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:24 devstack sudo[92263]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55" returned: 0 in 0.437s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:24 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55 Jul 13 20:33:24 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:24 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dfe38c9e-493a-4ccb-a85d-8cf6486bed55" returned: 0 in 0.273s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-dfe38c9e-493a-4ccb-a85d-8cf6486bed55" released by "delete_volume" :: held 0.852s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:25 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Created reservations ['67c6ab03-aa73-49db-8796-34a3a1efd3ee', 'f5cf9ee4-a351-443b-a05d-27f3c0735c88', '9f180fab-1475-4f4b-a143-2b58b6a59f49', 'd11b2ad4-d323-41a8-8012-cd6b33eaee39'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:33:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:25 devstack sudo[92271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:33:25 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:25 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.366s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:25 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:33:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Deleted volume successfully. Jul 13 20:33:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ca7a8cf-4e58-4014-8b11-844e929f5e36 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-dfe38c9e-493a-4ccb-a85d-8cf6486bed55-delete_volume" released by "delete_volume" :: held 5.624s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Flow 'volume_create_manager' (b33b4c36-96ef-45ae-be3a-b560c86e2fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4464feaa-1dcb-4ce0-ab79-414a5de1ed67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4464feaa-1dcb-4ce0-ab79-414a5de1ed67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2114740829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7c9b2c-52bf-49f4-990f-db6a8d22b5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fa8e28f5634435b27d83ea5c418e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:33:26Z,use_quota=True,user_id='a9339b73981644c0a9429a6e574ca85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1481be0-fbc6-4e30-ac50-c50bb3ddfd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1481be0-fbc6-4e30-ac50-c50bb3ddfd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8172a4f6-747d-42fa-be29-77fad351663b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8172a4f6-747d-42fa-be29-77fad351663b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b7c9b2c-52bf-49f4-990f-db6a8d22b5da', 'volume_name': 'volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29862bcf-9680-4f62-88e5-4c506cf013f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29862bcf-9680-4f62-88e5-4c506cf013f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a2a84a-5e65-424b-876d-9cefad8a4587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:26 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Volume 2b7c9b2c-52bf-49f4-990f-db6a8d22b5da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da', 'volume_size': 1} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2114740829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7c9b2c-52bf-49f4-990f-db6a8d22b5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fa8e28f5634435b27d83ea5c418e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:33:26Z,use_quota=True,user_id='a9339b73981644c0a9429a6e574ca85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Creating volume 2b7c9b2c-52bf-49f4-990f-db6a8d22b5da {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:33:26 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:26 devstack sudo[92274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da 1073741824 Jul 13 20:33:26 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:26 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da 1073741824" returned: 0 in 0.494s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:26 devstack sudo[92280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da Jul 13 20:33:26 devstack sudo[92280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:27 devstack sudo[92280]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da" returned: 0 in 0.310s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:33:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a2a84a-5e65-424b-876d-9cefad8a4587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d266d82a-2a10-4646-9fa4-cbeedf5d553d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:27 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Volume volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da (2b7c9b2c-52bf-49f4-990f-db6a8d22b5da): created successfully Jul 13 20:33:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d266d82a-2a10-4646-9fa4-cbeedf5d553d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Flow 'volume_create_manager' (b33b4c36-96ef-45ae-be3a-b560c86e2fb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:27 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-02cc58e7-8357-4af4-97e4-16ad40179045 tempest-VolumesDeleteCascade-980587823 None] Created volume successfully. Jul 13 20:33:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ff09d681-103f-4366-b603-75d23a056bc8 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ff09d681-103f-4366-b603-75d23a056bc8 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ff09d681-103f-4366-b603-75d23a056bc8 tempest-VolumesDeleteCascade-980587823 None] Creating offline snapshot 020f15cf-e285-4393-8ba7-25f31bfd83fd of volume 2b7c9b2c-52bf-49f4-990f-db6a8d22b5da {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:33:28 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c38e7f0-42d8-4ba3-9b07-e01e255564e5]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ff09d681-103f-4366-b603-75d23a056bc8 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:28 devstack sudo[92289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da Jul 13 20:33:28 devstack sudo[92289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:29 devstack sudo[92289]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ff09d681-103f-4366-b603-75d23a056bc8 tempest-VolumesDeleteCascade-980587823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da" returned: 0 in 0.662s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ff09d681-103f-4366-b603-75d23a056bc8 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:29 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd 1G Jul 13 20:33:29 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:29 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:33:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Flow 'volume_create_manager' (8c9cf697-24dd-4b0e-929b-3ab1a7a3438a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3452ee73-b292-4a11-a8ca-2e39a7d4137e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3452ee73-b292-4a11-a8ca-2e39a7d4137e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1590147619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d769909-a048-44b8-be91-23e657b380b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85445e2185194a74934b40338ce55195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:33:29Z,use_quota=True,user_id='c30d8cad61a741ab9a629409037fb101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a05803-e3e1-40a8-acf2-0a2c12c830aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a05803-e3e1-40a8-acf2-0a2c12c830aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c68becb-6e78-4ef7-a7f3-fdcf79a247cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c68becb-6e78-4ef7-a7f3-fdcf79a247cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d769909-a048-44b8-be91-23e657b380b0', 'volume_name': 'volume-5d769909-a048-44b8-be91-23e657b380b0', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9cf4c1-f45f-43d2-9ca4-0bc3eb9f8be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9cf4c1-f45f-43d2-9ca4-0bc3eb9f8be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b106e81-5d3c-4927-92d8-bdd681cfb30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:29 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Volume 5d769909-a048-44b8-be91-23e657b380b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d769909-a048-44b8-be91-23e657b380b0', 'volume_size': 1} Jul 13 20:33:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:30 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ff09d681-103f-4366-b603-75d23a056bc8 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd 1G" returned: 0 in 0.828s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ff09d681-103f-4366-b603-75d23a056bc8 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:30 devstack sudo[92315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd Jul 13 20:33:30 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:30 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ff09d681-103f-4366-b603-75d23a056bc8 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd" returned: 0 in 0.555s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:30 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-ff09d681-103f-4366-b603-75d23a056bc8 tempest-VolumesDeleteCascade-980587823 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd is being set with open permissions: ugo+rw Jul 13 20:33:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ff09d681-103f-4366-b603-75d23a056bc8 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:30 devstack sudo[92328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd Jul 13 20:33:30 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:31 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ff09d681-103f-4366-b603-75d23a056bc8 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd" returned: 0 in 0.342s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ff09d681-103f-4366-b603-75d23a056bc8 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:31 devstack sudo[92332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.info Jul 13 20:33:31 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:31 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ff09d681-103f-4366-b603-75d23a056bc8 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.info" returned: 0 in 0.465s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:31 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-ff09d681-103f-4366-b603-75d23a056bc8 tempest-VolumesDeleteCascade-980587823 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.info is being set with open permissions: ugo+rw Jul 13 20:33:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ff09d681-103f-4366-b603-75d23a056bc8 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:31 devstack sudo[92335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.info Jul 13 20:33:31 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:32 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ff09d681-103f-4366-b603-75d23a056bc8 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.info" returned: 0 in 0.548s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ff09d681-103f-4366-b603-75d23a056bc8 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.561s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.669s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1590147619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d769909-a048-44b8-be91-23e657b380b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85445e2185194a74934b40338ce55195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:33:29Z,use_quota=True,user_id='c30d8cad61a741ab9a629409037fb101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:33:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Creating volume 5d769909-a048-44b8-be91-23e657b380b0 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:33:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:33:32 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:33:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ff09d681-103f-4366-b603-75d23a056bc8 tempest-VolumesDeleteCascade-980587823 None] Create snapshot completed successfully Jul 13 20:33:32 devstack sudo[92339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 1073741824 Jul 13 20:33:32 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:33 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 1073741824" returned: 0 in 0.779s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:33 devstack sudo[92361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 Jul 13 20:33:33 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:33 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0" returned: 0 in 0.425s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:33:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b106e81-5d3c-4927-92d8-bdd681cfb30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d769909-a048-44b8-be91-23e657b380b0', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d48f5f6-167e-4e8c-8bab-3c14f7908334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:33 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Volume volume-5d769909-a048-44b8-be91-23e657b380b0 (5d769909-a048-44b8-be91-23e657b380b0): created successfully Jul 13 20:33:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d48f5f6-167e-4e8c-8bab-3c14f7908334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Flow 'volume_create_manager' (8c9cf697-24dd-4b0e-929b-3ab1a7a3438a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:33 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-809a30c2-b851-4c6b-b05d-5a4061172433 tempest-VolumesActionsTest-781154880 None] Created volume successfully. Jul 13 20:33:33 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:33:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Flow 'volume_create_manager' (a550e6ef-1704-4cb8-8c98-3195d945a17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4aac781-7b23-4faf-8a6d-4153746fd489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4aac781-7b23-4faf-8a6d-4153746fd489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1003327035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=975d11b9-b583-4f85-869f-9c78d804ece6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fa8e28f5634435b27d83ea5c418e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=020f15cf-e285-4393-8ba7-25f31bfd83fd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:33:34Z,use_quota=True,user_id='a9339b73981644c0a9429a6e574ca85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3738342-f2cd-417b-b3bf-ce16497a048b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3738342-f2cd-417b-b3bf-ce16497a048b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbdcc70-8c60-4f94-8a05-06950977fd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbdcc70-8c60-4f94-8a05-06950977fd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '975d11b9-b583-4f85-869f-9c78d804ece6', 'volume_name': 'volume-975d11b9-b583-4f85-869f-9c78d804ece6', 'volume_size': 1, 'snapshot_id': '020f15cf-e285-4393-8ba7-25f31bfd83fd'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e993634-3876-4a8d-9a24-e9697137e267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e993634-3876-4a8d-9a24-e9697137e267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bcf1157-d14f-4fdb-a1d8-d4aa084415bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:34 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Volume 975d11b9-b583-4f85-869f-9c78d804ece6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-975d11b9-b583-4f85-869f-9c78d804ece6', 'volume_size': 1, 'snapshot_id': '020f15cf-e285-4393-8ba7-25f31bfd83fd'} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "cinder-quobyte-020f15cf-e285-4393-8ba7-25f31bfd83fd-975d11b9-b583-4f85-869f-9c78d804ece6" by "_create_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-020f15cf-e285-4393-8ba7-25f31bfd83fd-975d11b9-b583-4f85-869f-9c78d804ece6" acquired by "_create_volume_from_snapshot" :: waited 0.082s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Creating volume 975d11b9-b583-4f85-869f-9c78d804ece6 from snapshot 020f15cf-e285-4393-8ba7-25f31bfd83fd {{(pid=87269) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "cinder-quobyte-975d11b9-b583-4f85-869f-9c78d804ece6" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-975d11b9-b583-4f85-869f-9c78d804ece6" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] snapshot: 020f15cf-e285-4393-8ba7-25f31bfd83fd, volume: 975d11b9-b583-4f85-869f-9c78d804ece6, {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[250b6cda-112f-4bea-a9e1-4378636f4313]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:34 devstack sudo[92384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd Jul 13 20:33:34 devstack sudo[92384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:35 devstack sudo[92384]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd" returned: 0 in 0.662s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:33:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 20:33:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 20:33:35 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24828b5-9a80-4b35-b1ca-40a7c4fdba8e]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:35 devstack sudo[92430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da Jul 13 20:33:35 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:35 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da" returned: 0 in 0.729s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:35 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Path /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-975d11b9-b583-4f85-869f-9c78d804ece6 not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 20:33:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-975d11b9-b583-4f85-869f-9c78d804ece6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:35 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-975d11b9-b583-4f85-869f-9c78d804ece6 Jul 13 20:33:35 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:40 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:33:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Flow 'volume_create_manager' (f314006e-559a-4c47-93d8-ca95965a34b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d5236f-e575-4169-819e-57687e7df835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d5236f-e575-4169-819e-57687e7df835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-923453311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779c8ed4-a0ed-42f8-b253-c700ba1056d3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1348140dd6964d458eda2bed664d00cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:33:40Z,use_quota=True,user_id='d9366a38b14346479608e45a824fd4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7a4794-6d33-468e-8623-5acadf127190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7a4794-6d33-468e-8623-5acadf127190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c2edd6-ec47-45d8-9041-ce7e49a0a4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c2edd6-ec47-45d8-9041-ce7e49a0a4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '779c8ed4-a0ed-42f8-b253-c700ba1056d3', 'volume_name': 'volume-779c8ed4-a0ed-42f8-b253-c700ba1056d3', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e0e67d-88f2-41cd-b6fc-e275622d80a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e0e67d-88f2-41cd-b6fc-e275622d80a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e37e98-e2e1-48a6-bde0-8f2af81b0e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:41 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Volume 779c8ed4-a0ed-42f8-b253-c700ba1056d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-779c8ed4-a0ed-42f8-b253-c700ba1056d3', 'volume_size': 1} Jul 13 20:33:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:47 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-975d11b9-b583-4f85-869f-9c78d804ece6" returned: 0 in 11.522s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:47 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d9f0d3-d71f-4b70-84fe-8bab5471826e]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:47 devstack sudo[92587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da Jul 13 20:33:47 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:48 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da" returned: 0 in 0.990s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:48 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da, size 1024.00 MB, duration 11.52 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-975d11b9-b583-4f85-869f-9c78d804ece6 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:33:48 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Converted 1024.00 MB image at 88.86 MB/s Jul 13 20:33:48 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-975d11b9-b583-4f85-869f-9c78d804ece6 is being set with open permissions: ugo+rw Jul 13 20:33:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-975d11b9-b583-4f85-869f-9c78d804ece6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:48 devstack sudo[92592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-975d11b9-b583-4f85-869f-9c78d804ece6 Jul 13 20:33:48 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:48 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-975d11b9-b583-4f85-869f-9c78d804ece6" returned: 0 in 0.526s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-975d11b9-b583-4f85-869f-9c78d804ece6" released by "_copy_volume_from_snapshot" :: held 14.628s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-020f15cf-e285-4393-8ba7-25f31bfd83fd-975d11b9-b583-4f85-869f-9c78d804ece6" released by "_create_volume_from_snapshot" :: held 14.714s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.798s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.775s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-923453311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779c8ed4-a0ed-42f8-b253-c700ba1056d3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1348140dd6964d458eda2bed664d00cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:33:40Z,use_quota=True,user_id='d9366a38b14346479608e45a824fd4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:33:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Creating volume 779c8ed4-a0ed-42f8-b253-c700ba1056d3 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:33:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:33:48 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:33:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-779c8ed4-a0ed-42f8-b253-c700ba1056d3 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:49 devstack sudo[92596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-779c8ed4-a0ed-42f8-b253-c700ba1056d3 1073741824 Jul 13 20:33:49 devstack sudo[92596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bcf1157-d14f-4fdb-a1d8-d4aa084415bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-975d11b9-b583-4f85-869f-9c78d804ece6', 'volume_size': 1, 'snapshot_id': '020f15cf-e285-4393-8ba7-25f31bfd83fd'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03471227-f1c2-4610-bb93-d307d85fff81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:49 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Volume volume-975d11b9-b583-4f85-869f-9c78d804ece6 (975d11b9-b583-4f85-869f-9c78d804ece6): created successfully Jul 13 20:33:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03471227-f1c2-4610-bb93-d307d85fff81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Flow 'volume_create_manager' (a550e6ef-1704-4cb8-8c98-3195d945a17f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:49 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3c56833a-eef0-4d3e-a591-c7a4a96e0a33 tempest-VolumesDeleteCascade-980587823 None] Created volume successfully. Jul 13 20:33:49 devstack sudo[92596]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-779c8ed4-a0ed-42f8-b253-c700ba1056d3 1073741824" returned: 0 in 0.779s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-779c8ed4-a0ed-42f8-b253-c700ba1056d3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:49 devstack sudo[92602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-779c8ed4-a0ed-42f8-b253-c700ba1056d3 Jul 13 20:33:49 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "cinder-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Performing cascade delete. {{(pid=87269) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "cinder-020f15cf-e285-4393-8ba7-25f31bfd83fd-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-020f15cf-e285-4393-8ba7-25f31bfd83fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:50 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-779c8ed4-a0ed-42f8-b253-c700ba1056d3" returned: 0 in 0.696s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "cinder-quobyte-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e37e98-e2e1-48a6-bde0-8f2af81b0e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-779c8ed4-a0ed-42f8-b253-c700ba1056d3', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac7fa080-99ad-47e2-95b5-f795249f4275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da" acquired by "delete_snapshot" :: waited 0.081s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "cinder-quobyte-020f15cf-e285-4393-8ba7-25f31bfd83fd" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:50 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Volume volume-779c8ed4-a0ed-42f8-b253-c700ba1056d3 (779c8ed4-a0ed-42f8-b253-c700ba1056d3): created successfully Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac7fa080-99ad-47e2-95b5-f795249f4275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Flow 'volume_create_manager' (f314006e-559a-4c47-93d8-ca95965a34b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-020f15cf-e285-4393-8ba7-25f31bfd83fd" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Deleting offline snapshot 020f15cf-e285-4393-8ba7-25f31bfd83fd of volume 2b7c9b2c-52bf-49f4-990f-db6a8d22b5da {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] snapshot_file for this snap is: volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:33:50 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-f6badded-233e-4ad3-8ee1-bd18207ba61a req-754dbb87-4ef9-4296-a942-44bd644b4ffa tempest-VolumesGetTestJSON-1324720224 None] Created volume successfully. Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5a106c-a215-4754-ac86-d84ac9ad0a8d]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:50 devstack sudo[92635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd Jul 13 20:33:50 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:51 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd" returned: 0 in 0.448s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:33:51 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[873b6ff1-a71b-4495-99e7-2e63d27b5ac3]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:51 devstack sudo[92648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da Jul 13 20:33:51 devstack sudo[92648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] Acquiring lock "cinder-779c8ed4-a0ed-42f8-b253-c700ba1056d3-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] Lock "cinder-779c8ed4-a0ed-42f8-b253-c700ba1056d3-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] Acquiring lock "cinder-quobyte-779c8ed4-a0ed-42f8-b253-c700ba1056d3" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] Lock "cinder-quobyte-779c8ed4-a0ed-42f8-b253-c700ba1056d3" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:51 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8995edda-4119-45d7-b60a-4d69e3a1c0cc]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-779c8ed4-a0ed-42f8-b253-c700ba1056d3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:52 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-779c8ed4-a0ed-42f8-b253-c700ba1056d3 Jul 13 20:33:52 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:52 devstack sudo[92648]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da" returned: 0 in 1.031s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:52 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd Jul 13 20:33:52 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:52 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-779c8ed4-a0ed-42f8-b253-c700ba1056d3" returned: 0 in 1.008s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-779c8ed4-a0ed-42f8-b253-c700ba1056d3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:52 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-779c8ed4-a0ed-42f8-b253-c700ba1056d3 Jul 13 20:33:52 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:53 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd" returned: 0 in 0.813s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:53 devstack sudo[92753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd Jul 13 20:33:53 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:53 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-779c8ed4-a0ed-42f8-b253-c700ba1056d3" returned: 0 in 0.634s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] Lock "cinder-quobyte-779c8ed4-a0ed-42f8-b253-c700ba1056d3" released by "delete_volume" :: held 1.788s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:53 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da.020f15cf-e285-4393-8ba7-25f31bfd83fd" returned: 0 in 0.564s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-020f15cf-e285-4393-8ba7-25f31bfd83fd" released by "_delete_snapshot" :: held 3.077s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da" released by "delete_snapshot" :: held 3.169s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:53 devstack cinder-volume[87269]: DEBUG cinder.quota [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] Created reservations ['81e8728a-382e-4000-bd89-adca6c75d6c0', 'b8046968-f46d-4163-97ea-2462381604bf', 'cd4504df-9af0-4e99-9ccb-4b8e829ccda6', '476bc0e0-0d8c-4eac-9cee-0abb0a33d2b5'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:33:53 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Created reservations ['a2943a53-d811-4ac6-8a79-6b83b384c556', '2be7989e-da33-4b31-b25b-2c2b0a32941e', '9c4f189c-3590-43cd-bf00-bab8afd38562', '88bd90ce-150f-423b-951d-40ba276a18fb'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:33:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Delete snapshot completed successfully. Jul 13 20:33:54 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:33:54 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-020f15cf-e285-4393-8ba7-25f31bfd83fd-delete_snapshot" released by "delete_snapshot" :: held 3.693s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Snapshots deleted, issuing volume delete {{(pid=87269) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 13 20:33:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "cinder-quobyte-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da" acquired by "delete_volume" :: waited 0.064s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:54 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1285658c-2175-4052-84bf-b6ba25caab89]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:54 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.628s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:54 devstack cinder-volume[87269]: DEBUG cinder.manager [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:33:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] Deleted volume successfully. Jul 13 20:33:54 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da Jul 13 20:33:54 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-f35a2875-ada5-4faa-a2b8-a28ddcb6688c req-42b61709-5f82-431e-b445-77c90cdd381c tempest-VolumesGetTestJSON-1324720224 None] Lock "cinder-779c8ed4-a0ed-42f8-b253-c700ba1056d3-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:55 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da" returned: 0 in 0.939s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:55 devstack sudo[92777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da Jul 13 20:33:55 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8c5bd74f-0b2b-480b-98bc-d6f4309f946a tempest-VolumesActionsTest-781154880 None] Acquiring lock "cinder-5d769909-a048-44b8-be91-23e657b380b0" by "attach_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8c5bd74f-0b2b-480b-98bc-d6f4309f946a tempest-VolumesActionsTest-781154880 None] Lock "cinder-5d769909-a048-44b8-be91-23e657b380b0" acquired by "attach_volume" :: waited 0.055s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:55 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da" returned: 0 in 0.479s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da" released by "delete_volume" :: held 1.574s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8c5bd74f-0b2b-480b-98bc-d6f4309f946a tempest-VolumesActionsTest-781154880 None] Attaching volume 5d769909-a048-44b8-be91-23e657b380b0 to instance da576ec2-697c-4954-bf21-cc77fbae4773 at mountpoint /dev/vdb on host None. Jul 13 20:33:55 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Created reservations ['3834c26e-ebe7-46d0-b4c3-3c94f2a52975', 'a69b1917-a42e-4060-9d1f-3994f516d506', '92693976-010c-42c7-9420-f1b7548eb324', '102c4eaf-3793-4013-bb57-24fd40348a97'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:33:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8c5bd74f-0b2b-480b-98bc-d6f4309f946a tempest-VolumesActionsTest-781154880 None] Attach volume completed successfully. Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8c5bd74f-0b2b-480b-98bc-d6f4309f946a tempest-VolumesActionsTest-781154880 None] Lock "cinder-5d769909-a048-44b8-be91-23e657b380b0" released by "attach_volume" :: held 0.375s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Flow 'volume_create_manager' (47939f84-6be5-4c1e-b70f-e1a2324c458a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab9f4d6-f1e3-49ec-8885-b347268c8650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b3cf914b-c807-4f8b-af9e-6de574cbf820 tempest-VolumesActionsTest-781154880 None] Acquiring lock "cinder-5d769909-a048-44b8-be91-23e657b380b0-detach_volume" by "detach_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:56 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:33:56 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab9f4d6-f1e3-49ec-8885-b347268c8650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-220011493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7870484d-2ba8-4ea1-a6c1-c8b8121742f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6d372741464bb292bc1f7f47c8f57c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:33:56Z,use_quota=True,user_id='a5ce155581954cbf984a67dca4d9134f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d5b5ec-6ee8-4975-b381-02ee864a3b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d5b5ec-6ee8-4975-b381-02ee864a3b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (548728ec-20ed-4551-b93c-ee90e551c9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (548728ec-20ed-4551-b93c-ee90e551c9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7870484d-2ba8-4ea1-a6c1-c8b8121742f9', 'volume_name': 'volume-7870484d-2ba8-4ea1-a6c1-c8b8121742f9', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b055d46-bb73-4efa-96b0-886a76636637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b055d46-bb73-4efa-96b0-886a76636637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc93f43-b1aa-4256-b0b4-826891cd8edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:56 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Volume 7870484d-2ba8-4ea1-a6c1-c8b8121742f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7870484d-2ba8-4ea1-a6c1-c8b8121742f9', 'volume_size': 1} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-220011493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7870484d-2ba8-4ea1-a6c1-c8b8121742f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6d372741464bb292bc1f7f47c8f57c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:33:56Z,use_quota=True,user_id='a5ce155581954cbf984a67dca4d9134f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Creating volume 7870484d-2ba8-4ea1-a6c1-c8b8121742f9 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:33:56 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7870484d-2ba8-4ea1-a6c1-c8b8121742f9 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b3cf914b-c807-4f8b-af9e-6de574cbf820 tempest-VolumesActionsTest-781154880 None] Lock "cinder-5d769909-a048-44b8-be91-23e657b380b0-detach_volume" acquired by "detach_volume" :: waited 0.199s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:56 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b3cf914b-c807-4f8b-af9e-6de574cbf820 tempest-VolumesActionsTest-781154880 None] Detaching volume 5d769909-a048-44b8-be91-23e657b380b0 from instance da576ec2-697c-4954-bf21-cc77fbae4773. Jul 13 20:33:56 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7870484d-2ba8-4ea1-a6c1-c8b8121742f9 1073741824 Jul 13 20:33:56 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "cinder-975d11b9-b583-4f85-869f-9c78d804ece6-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-975d11b9-b583-4f85-869f-9c78d804ece6-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:56 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.427s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:33:56 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Deleted volume successfully. Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "cinder-quobyte-975d11b9-b583-4f85-869f-9c78d804ece6" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-975d11b9-b583-4f85-869f-9c78d804ece6" acquired by "delete_volume" :: waited 0.040s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:33:56 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b3cf914b-c807-4f8b-af9e-6de574cbf820 tempest-VolumesActionsTest-781154880 None] Detach volume completed successfully. Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b3cf914b-c807-4f8b-af9e-6de574cbf820 tempest-VolumesActionsTest-781154880 None] Lock "cinder-5d769909-a048-44b8-be91-23e657b380b0-detach_volume" released by "detach_volume" :: held 0.397s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-286e6386-45a5-4fd9-9a00-458aed3a12ab tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-2b7c9b2c-52bf-49f4-990f-db6a8d22b5da-delete_volume" released by "delete_volume" :: held 6.685s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:57 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6951f89e-c2d4-46f1-a95e-50e268c53573]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:33:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-975d11b9-b583-4f85-869f-9c78d804ece6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:57 devstack sudo[92787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-975d11b9-b583-4f85-869f-9c78d804ece6 Jul 13 20:33:57 devstack sudo[92787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:57 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7870484d-2ba8-4ea1-a6c1-c8b8121742f9 1073741824" returned: 0 in 0.960s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7870484d-2ba8-4ea1-a6c1-c8b8121742f9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:57 devstack sudo[92795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7870484d-2ba8-4ea1-a6c1-c8b8121742f9 Jul 13 20:33:57 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:57 devstack sudo[92787]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-975d11b9-b583-4f85-869f-9c78d804ece6" returned: 0 in 0.682s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-975d11b9-b583-4f85-869f-9c78d804ece6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:57 devstack sudo[92797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-975d11b9-b583-4f85-869f-9c78d804ece6 Jul 13 20:33:57 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:58 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-975d11b9-b583-4f85-869f-9c78d804ece6" returned: 0 in 0.490s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-quobyte-975d11b9-b583-4f85-869f-9c78d804ece6" released by "delete_volume" :: held 1.298s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:33:58 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7870484d-2ba8-4ea1-a6c1-c8b8121742f9" returned: 0 in 0.821s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:33:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc93f43-b1aa-4256-b0b4-826891cd8edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7870484d-2ba8-4ea1-a6c1-c8b8121742f9', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a55867b-e4fd-4708-80a4-7f988a268f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:33:58 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Volume volume-7870484d-2ba8-4ea1-a6c1-c8b8121742f9 (7870484d-2ba8-4ea1-a6c1-c8b8121742f9): created successfully Jul 13 20:33:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a55867b-e4fd-4708-80a4-7f988a268f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:33:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Flow 'volume_create_manager' (47939f84-6be5-4c1e-b70f-e1a2324c458a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:33:58 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] Created reservations ['c4e97d37-c360-4800-a27f-48fc7e12f450', '4040c075-9bdc-4a6d-b99a-5a303274a7d1', '8bb394fc-9bf6-49ba-8a4b-68712a97237d', '213f21cf-53fa-4b52-a0f2-7a867dcf7567'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:33:58 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f4171f18-715e-456b-bbd2-845d07f26121 tempest-ServerRescueNegativeTestJSON-1602311142 None] Created volume successfully. Jul 13 20:33:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:33:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:33:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:33:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:33:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:33:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:33:58 devstack sudo[92823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:33:58 devstack sudo[92823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:33:59 devstack sudo[92823]: pam_unix(sudo:session): session closed for user root Jul 13 20:33:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.373s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:33:59 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:33:59 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] Deleted volume successfully. Jul 13 20:33:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dff47689-52d9-4194-b67c-56bad7759b20 tempest-VolumesDeleteCascade-980587823 None] Lock "cinder-975d11b9-b583-4f85-869f-9c78d804ece6-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:34:08 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:DELETE=7,cinder:UPDATE=66,cinder:SELECT=65,cinder:INSERT=15 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:34:09 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=95,cinder:INSERT=34,cinder:UPDATE=119,cinder:DELETE=8 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Flow 'volume_create_manager' (378c6346-5930-43de-95c2-34c38e10b54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3636c773-d117-4ff5-b22d-248087584a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3636c773-d117-4ff5-b22d-248087584a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-34655834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98149010-4ea0-4bca-aac6-0d1ff63e632d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940eaebe319947cc964f841c57077f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:34:11Z,use_quota=True,user_id='42d8bc7e4b9442eca1763042cdf4190b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (198b5851-2530-4218-a384-87a88d234f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (198b5851-2530-4218-a384-87a88d234f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0819f772-91ce-4741-abb8-94ae17360a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0819f772-91ce-4741-abb8-94ae17360a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98149010-4ea0-4bca-aac6-0d1ff63e632d', 'volume_name': 'volume-98149010-4ea0-4bca-aac6-0d1ff63e632d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab8447c-6ed9-4ad8-b006-5a303019ca23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab8447c-6ed9-4ad8-b006-5a303019ca23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb18701-6407-4fe4-9763-f40e71a78617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:10 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Volume 98149010-4ea0-4bca-aac6-0d1ff63e632d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98149010-4ea0-4bca-aac6-0d1ff63e632d', 'volume_size': 1} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-34655834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98149010-4ea0-4bca-aac6-0d1ff63e632d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940eaebe319947cc964f841c57077f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:34:11Z,use_quota=True,user_id='42d8bc7e4b9442eca1763042cdf4190b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Creating volume 98149010-4ea0-4bca-aac6-0d1ff63e632d {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:34:10 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:34:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-98149010-4ea0-4bca-aac6-0d1ff63e632d 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:10 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-98149010-4ea0-4bca-aac6-0d1ff63e632d 1073741824 Jul 13 20:34:10 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:11 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-98149010-4ea0-4bca-aac6-0d1ff63e632d 1073741824" returned: 0 in 0.702s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-98149010-4ea0-4bca-aac6-0d1ff63e632d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:11 devstack sudo[92951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-98149010-4ea0-4bca-aac6-0d1ff63e632d Jul 13 20:34:11 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:11 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-98149010-4ea0-4bca-aac6-0d1ff63e632d" returned: 0 in 0.461s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:34:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:34:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb18701-6407-4fe4-9763-f40e71a78617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98149010-4ea0-4bca-aac6-0d1ff63e632d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08efab5d-e558-4d25-93b0-b767602977d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:12 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Volume volume-98149010-4ea0-4bca-aac6-0d1ff63e632d (98149010-4ea0-4bca-aac6-0d1ff63e632d): created successfully Jul 13 20:34:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08efab5d-e558-4d25-93b0-b767602977d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Flow 'volume_create_manager' (378c6346-5930-43de-95c2-34c38e10b54b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:34:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8625b4c5-ce88-49ce-b89a-e99e473cf20e tempest-VolumesTransfersV355Test-942167238 None] Created volume successfully. Jul 13 20:34:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f87390d2-36f8-4944-9d65-1932c5ba3ef5 tempest-GroupSnapshotsTest-1740638669 None] Group tempest-GroupSnapshotsTest-Group-1477471267: creating Jul 13 20:34:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f87390d2-36f8-4944-9d65-1932c5ba3ef5 tempest-GroupSnapshotsTest-1740638669 None] Group tempest-GroupSnapshotsTest-Group-1477471267: created successfully Jul 13 20:34:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f87390d2-36f8-4944-9d65-1932c5ba3ef5 tempest-GroupSnapshotsTest-1740638669 None] Create group completed successfully. Jul 13 20:34:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] Acquiring lock "cinder-7870484d-2ba8-4ea1-a6c1-c8b8121742f9-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:34:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] Lock "cinder-7870484d-2ba8-4ea1-a6c1-c8b8121742f9-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:34:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] Acquiring lock "cinder-quobyte-7870484d-2ba8-4ea1-a6c1-c8b8121742f9" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:34:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] Lock "cinder-quobyte-7870484d-2ba8-4ea1-a6c1-c8b8121742f9" acquired by "delete_volume" :: waited 0.035s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:34:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da56374-f827-40d1-9016-53461aab0600]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:34:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7870484d-2ba8-4ea1-a6c1-c8b8121742f9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e8d93e6e-e566-4a41-a58f-db25cd88bf36 tempest-VolumesTransfersV355Test-739876139 None] Transfer volume completed successfully. Jul 13 20:34:14 devstack sudo[93024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7870484d-2ba8-4ea1-a6c1-c8b8121742f9 Jul 13 20:34:14 devstack sudo[93024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:15 devstack sudo[93024]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7870484d-2ba8-4ea1-a6c1-c8b8121742f9" returned: 0 in 0.939s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7870484d-2ba8-4ea1-a6c1-c8b8121742f9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:15 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7870484d-2ba8-4ea1-a6c1-c8b8121742f9 Jul 13 20:34:15 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:15 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:15 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:34:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Flow 'volume_create_manager' (e8fb3202-ee7d-4ed6-b011-89f73ac161b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:34:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365154fe-7716-4c21-8ffd-890e0382d58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7870484d-2ba8-4ea1-a6c1-c8b8121742f9" returned: 0 in 0.917s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] Acquiring lock "cinder-98149010-4ea0-4bca-aac6-0d1ff63e632d-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365154fe-7716-4c21-8ffd-890e0382d58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1473508361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bec839bc-d8be-4be0-ac5b-758e138c420b,host='devstack@QuobyteHD#QuobyteHD',id=49325195-d1d9-444f-9c79-ab7c82acd8fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92748ca3e6bc43c089ea60f8f0c1bb34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:34:16Z,use_quota=True,user_id='50c969f9be054515ae851ed4cdca2a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be7422f2-cf52-47e1-af4e-3d11dcf668e6),volume_type_id=be7422f2-cf52-47e1-af4e-3d11dcf668e6)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0e197e-dfff-4dcc-9566-6e5f4cc7ee4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0e197e-dfff-4dcc-9566-6e5f4cc7ee4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3661ef6-8c48-40c0-925d-fbf7e962e653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3661ef6-8c48-40c0-925d-fbf7e962e653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49325195-d1d9-444f-9c79-ab7c82acd8fc', 'volume_name': 'volume-49325195-d1d9-444f-9c79-ab7c82acd8fc', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f44bc23-5742-477e-92fb-c1f7c1f643b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f44bc23-5742-477e-92fb-c1f7c1f643b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48b065a-cdd4-426b-aeb0-f933002f4f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:16 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Volume 49325195-d1d9-444f-9c79-ab7c82acd8fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49325195-d1d9-444f-9c79-ab7c82acd8fc', 'volume_size': 1} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bec839bc-d8be-4be0-ac5b-758e138c420b,created_at=2026-07-13T18:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1473508361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bec839bc-d8be-4be0-ac5b-758e138c420b,host='devstack@QuobyteHD#QuobyteHD',id=49325195-d1d9-444f-9c79-ab7c82acd8fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92748ca3e6bc43c089ea60f8f0c1bb34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:34:16Z,use_quota=True,user_id='50c969f9be054515ae851ed4cdca2a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be7422f2-cf52-47e1-af4e-3d11dcf668e6),volume_type_id=be7422f2-cf52-47e1-af4e-3d11dcf668e6)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Creating volume 49325195-d1d9-444f-9c79-ab7c82acd8fc {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:34:16 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] Lock "cinder-quobyte-7870484d-2ba8-4ea1-a6c1-c8b8121742f9" released by "delete_volume" :: held 2.105s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] Lock "cinder-98149010-4ea0-4bca-aac6-0d1ff63e632d-delete_volume" acquired by "delete_volume" :: waited 0.170s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:34:16 devstack sudo[93036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc 1073741824 Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] Acquiring lock "cinder-quobyte-98149010-4ea0-4bca-aac6-0d1ff63e632d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:34:16 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] Lock "cinder-quobyte-98149010-4ea0-4bca-aac6-0d1ff63e632d" acquired by "delete_volume" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] Created reservations ['a194f6c8-e624-45bb-b804-058ec11ab0b2', 'fb8522d7-507f-408e-aaa8-7522449499fd', 'bec82cba-b5d9-4295-8aeb-232b39c8dd9f', '1b2d7fe2-8117-43da-9e90-a121b2d8dc48'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[129844e6-79c0-40d0-bdd5-796b352f8260]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-98149010-4ea0-4bca-aac6-0d1ff63e632d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8e90e19e-ad3d-40a0-aeb0-6b2f06581079 tempest-VolumesActionsTest-781154880 None] Acquiring lock "cinder-5d769909-a048-44b8-be91-23e657b380b0" by "attach_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8e90e19e-ad3d-40a0-aeb0-6b2f06581079 tempest-VolumesActionsTest-781154880 None] Lock "cinder-5d769909-a048-44b8-be91-23e657b380b0" acquired by "attach_volume" :: waited 0.043s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:34:16 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-98149010-4ea0-4bca-aac6-0d1ff63e632d Jul 13 20:34:16 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:16 devstack sudo[93040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:34:16 devstack sudo[93040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8e90e19e-ad3d-40a0-aeb0-6b2f06581079 tempest-VolumesActionsTest-781154880 None] Attaching volume 5d769909-a048-44b8-be91-23e657b380b0 to instance ee760712-de91-466a-a842-41de48355ef3 at mountpoint /dev/vdb on host None. Jul 13 20:34:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8e90e19e-ad3d-40a0-aeb0-6b2f06581079 tempest-VolumesActionsTest-781154880 None] Attach volume completed successfully. Jul 13 20:34:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8e90e19e-ad3d-40a0-aeb0-6b2f06581079 tempest-VolumesActionsTest-781154880 None] Lock "cinder-5d769909-a048-44b8-be91-23e657b380b0" released by "attach_volume" :: held 0.390s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:34:17 devstack sudo[93040]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.462s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:17 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:34:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] Deleted volume successfully. Jul 13 20:34:17 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-98149010-4ea0-4bca-aac6-0d1ff63e632d" returned: 0 in 0.808s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-98149010-4ea0-4bca-aac6-0d1ff63e632d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-34785b0e-943c-44db-9153-e9969f69fee4 tempest-ServerRescueNegativeTestJSON-1602311142 None] Lock "cinder-7870484d-2ba8-4ea1-a6c1-c8b8121742f9-delete_volume" released by "delete_volume" :: held 3.297s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:34:17 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-98149010-4ea0-4bca-aac6-0d1ff63e632d Jul 13 20:34:17 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-465b633c-7ff0-4a95-a9b2-e7b21cc659f7 tempest-VolumesActionsTest-781154880 None] Acquiring lock "cinder-5d769909-a048-44b8-be91-23e657b380b0-detach_volume" by "detach_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:34:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-465b633c-7ff0-4a95-a9b2-e7b21cc659f7 tempest-VolumesActionsTest-781154880 None] Lock "cinder-5d769909-a048-44b8-be91-23e657b380b0-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:34:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-465b633c-7ff0-4a95-a9b2-e7b21cc659f7 tempest-VolumesActionsTest-781154880 None] Detaching volume 5d769909-a048-44b8-be91-23e657b380b0 from instance ee760712-de91-466a-a842-41de48355ef3. Jul 13 20:34:17 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-98149010-4ea0-4bca-aac6-0d1ff63e632d" returned: 0 in 0.497s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] Lock "cinder-quobyte-98149010-4ea0-4bca-aac6-0d1ff63e632d" released by "delete_volume" :: held 1.418s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:34:17 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc 1073741824" returned: 0 in 1.663s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-465b633c-7ff0-4a95-a9b2-e7b21cc659f7 tempest-VolumesActionsTest-781154880 None] Detach volume completed successfully. Jul 13 20:34:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-465b633c-7ff0-4a95-a9b2-e7b21cc659f7 tempest-VolumesActionsTest-781154880 None] Lock "cinder-5d769909-a048-44b8-be91-23e657b380b0-detach_volume" released by "detach_volume" :: held 0.274s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:34:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:17 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] Created reservations ['e63bfab3-7a4b-4125-9a30-782c068d7719', '9a4e01f0-3933-4061-8f21-1560a6dcc5a6', '0d96ecab-0379-4e3c-a801-0e6172bdbaf5', 'd0e0286e-f3b5-4485-a820-bc1adaa1fddf'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:34:18 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc Jul 13 20:34:18 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:34:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:34:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:34:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:34:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:34:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:18 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:34:18 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:18 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:34:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:34:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:34:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:34:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:34:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:34:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.802s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:34:19 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:34:19 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] Deleted volume successfully. Jul 13 20:34:19 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc" returned: 0 in 1.289s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] <== create_volume: return (3110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:34:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.113s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:34:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-886d20e1-de37-4ccb-b291-f8ed6ff888b5 tempest-VolumesTransfersV355Test-1651660109 None] Lock "cinder-98149010-4ea0-4bca-aac6-0d1ff63e632d-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:34:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48b065a-cdd4-426b-aeb0-f933002f4f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49325195-d1d9-444f-9c79-ab7c82acd8fc', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11ce3d8c-4018-42e5-af22-0c7196338567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:19 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Volume volume-49325195-d1d9-444f-9c79-ab7c82acd8fc (49325195-d1d9-444f-9c79-ab7c82acd8fc): created successfully Jul 13 20:34:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11ce3d8c-4018-42e5-af22-0c7196338567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Flow 'volume_create_manager' (e8fb3202-ee7d-4ed6-b011-89f73ac161b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:34:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d3914694-bd18-46f3-9cdb-d16e26d39e05 tempest-GroupSnapshotsTest-1740638669 None] Created volume successfully. Jul 13 20:34:19 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.619s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:34:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:34:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:34:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:34:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] GroupSnapshot b4c4f5b0-cf51-458a-92aa-58d5c6503b64: creating. Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] Group snapshot b4c4f5b0-cf51-458a-92aa-58d5c6503b64: creating. {{(pid=87269) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] Creating offline snapshot 20558d22-ebb6-4aab-980b-c35b3caf13ba of volume 49325195-d1d9-444f-9c79-ab7c82acd8fc {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b6d8dd-2199-41af-9bf4-b2b4f18f908f]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Flow 'volume_create_manager' (dab3d569-933d-4c65-b51b-b9e3659c76d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:34:21 devstack sudo[93113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc Jul 13 20:34:21 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7704cfed-06f6-464e-905e-0e71b72398a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7704cfed-06f6-464e-905e-0e71b72398a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-394172743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a07e38a-af96-4cb8-aed9-e80341320fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940eaebe319947cc964f841c57077f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:34:21Z,use_quota=True,user_id='42d8bc7e4b9442eca1763042cdf4190b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0055d391-ec78-4c06-a7ba-dffa29139adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0055d391-ec78-4c06-a7ba-dffa29139adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59beddd7-6443-4657-8361-c94b24850bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59beddd7-6443-4657-8361-c94b24850bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a07e38a-af96-4cb8-aed9-e80341320fce', 'volume_name': 'volume-2a07e38a-af96-4cb8-aed9-e80341320fce', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb809df-7136-4306-abbd-486eaba172fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb809df-7136-4306-abbd-486eaba172fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058215d4-2f8e-4000-9cdd-ab61dcfa2de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:21 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Volume 2a07e38a-af96-4cb8-aed9-e80341320fce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a07e38a-af96-4cb8-aed9-e80341320fce', 'volume_size': 1} Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:34:21 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc" returned: 0 in 0.708s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:21 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba 1G Jul 13 20:34:21 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:22 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba 1G" returned: 0 in 0.591s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49325195-d1d9-444f-9c79-ab7c82acd8fc -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:22 devstack sudo[93128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49325195-d1d9-444f-9c79-ab7c82acd8fc -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba Jul 13 20:34:22 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:22 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49325195-d1d9-444f-9c79-ab7c82acd8fc -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba" returned: 0 in 0.415s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:22 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba is being set with open permissions: ugo+rw: NotImplementedError Jul 13 20:34:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:22 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba Jul 13 20:34:22 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:23 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba" returned: 0 in 0.324s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:23 devstack sudo[93156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.info Jul 13 20:34:23 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:23 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.info" returned: 0 in 0.296s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:23 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.info is being set with open permissions: ugo+rw: NotImplementedError Jul 13 20:34:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:23 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.info Jul 13 20:34:23 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:23 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.info" returned: 0 in 0.323s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.794s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:34:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.342s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:34:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-394172743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a07e38a-af96-4cb8-aed9-e80341320fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940eaebe319947cc964f841c57077f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:34:21Z,use_quota=True,user_id='42d8bc7e4b9442eca1763042cdf4190b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:34:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Creating volume 2a07e38a-af96-4cb8-aed9-e80341320fce {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:34:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:34:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:34:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:34:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:34:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:34:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:34:23 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:34:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a07e38a-af96-4cb8-aed9-e80341320fce 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:23 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a07e38a-af96-4cb8-aed9-e80341320fce 1073741824 Jul 13 20:34:23 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:24 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1c209dc7-b52c-4c40-9951-4387dd10c28d tempest-GroupSnapshotsTest-1740638669 None] group_snapshot b4c4f5b0-cf51-458a-92aa-58d5c6503b64: created successfully Jul 13 20:34:24 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a07e38a-af96-4cb8-aed9-e80341320fce 1073741824" returned: 0 in 0.616s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a07e38a-af96-4cb8-aed9-e80341320fce {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:24 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a07e38a-af96-4cb8-aed9-e80341320fce Jul 13 20:34:24 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-32602b2f-fa56-4372-9ac2-e1cc523f8dab tempest-VolumesActionsTest-781154880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:34:24 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a07e38a-af96-4cb8-aed9-e80341320fce" returned: 0 in 0.368s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:34:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:34:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-32602b2f-fa56-4372-9ac2-e1cc523f8dab tempest-VolumesActionsTest-781154880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:34:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058215d4-2f8e-4000-9cdd-ab61dcfa2de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a07e38a-af96-4cb8-aed9-e80341320fce', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e8fb42-3024-437d-9109-5ca3aad7e7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a25c8d-14d3-464e-a0e0-a478bce70b07]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:34:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-32602b2f-fa56-4372-9ac2-e1cc523f8dab tempest-VolumesActionsTest-781154880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:24 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Volume volume-2a07e38a-af96-4cb8-aed9-e80341320fce (2a07e38a-af96-4cb8-aed9-e80341320fce): created successfully Jul 13 20:34:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e8fb42-3024-437d-9109-5ca3aad7e7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Flow 'volume_create_manager' (dab3d569-933d-4c65-b51b-b9e3659c76d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:34:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-cc7eb5cc-9582-4530-a5b7-8bcb071a94cd tempest-VolumesTransfersV355Test-942167238 None] Created volume successfully. Jul 13 20:34:25 devstack sudo[93174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 Jul 13 20:34:25 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:34:25 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-32602b2f-fa56-4372-9ac2-e1cc523f8dab tempest-VolumesActionsTest-781154880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0" returned: 0 in 0.437s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:25 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f49a7c-dbf2-4719-abf3-c31132044621]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:34:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-32602b2f-fa56-4372-9ac2-e1cc523f8dab tempest-VolumesActionsTest-781154880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:25 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 Jul 13 20:34:25 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] Acquiring lock "cinder-2a07e38a-af96-4cb8-aed9-e80341320fce-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:34:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] Lock "cinder-2a07e38a-af96-4cb8-aed9-e80341320fce-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:34:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] Acquiring lock "cinder-quobyte-2a07e38a-af96-4cb8-aed9-e80341320fce" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:34:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] Lock "cinder-quobyte-2a07e38a-af96-4cb8-aed9-e80341320fce" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:34:25 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aecdcad-11f4-429f-99df-d29d492b74b1]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:34:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a07e38a-af96-4cb8-aed9-e80341320fce {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:25 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-32602b2f-fa56-4372-9ac2-e1cc523f8dab tempest-VolumesActionsTest-781154880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0" returned: 0 in 0.421s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-32602b2f-fa56-4372-9ac2-e1cc523f8dab tempest-VolumesActionsTest-781154880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 /opt/stack/data/cinder/conversion/5d769909-a048-44b8-be91-23e657b380b0.temp_image.556aea60-2c2b-4217-8c03-2373c7257731k9fz5cvi.img {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:25 devstack sudo[93181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a07e38a-af96-4cb8-aed9-e80341320fce Jul 13 20:34:25 devstack sudo[93181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:25 devstack sudo[93186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 /opt/stack/data/cinder/conversion/5d769909-a048-44b8-be91-23e657b380b0.temp_image.556aea60-2c2b-4217-8c03-2373c7257731k9fz5cvi.img Jul 13 20:34:25 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:26 devstack sudo[93181]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a07e38a-af96-4cb8-aed9-e80341320fce" returned: 0 in 0.429s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a07e38a-af96-4cb8-aed9-e80341320fce {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:26 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a07e38a-af96-4cb8-aed9-e80341320fce Jul 13 20:34:26 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:26 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a07e38a-af96-4cb8-aed9-e80341320fce" returned: 0 in 0.464s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] Lock "cinder-quobyte-2a07e38a-af96-4cb8-aed9-e80341320fce" released by "delete_volume" :: held 0.970s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:34:26 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] Created reservations ['23aa5bab-a5e3-4cc5-bf7c-e1910a3b2cc4', 'f140ae3b-5cab-4ed5-8c21-e723d224c3f2', 'f021771d-dd02-4fc6-afe9-abc90972067b', '72bd2aa3-6ed2-46e7-a1e3-a6aff5865d51'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:34:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:34:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:34:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:34:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:34:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:34:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:27 devstack sudo[93205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:34:27 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:27 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.521s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:27 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:34:27 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] Deleted volume successfully. Jul 13 20:34:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2ea6a5fc-9789-4d96-a59c-ec411742e1aa tempest-VolumesTransfersV355Test-1651660109 None] Lock "cinder-2a07e38a-af96-4cb8-aed9-e80341320fce-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:34:30 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-32602b2f-fa56-4372-9ac2-e1cc523f8dab tempest-VolumesActionsTest-781154880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 /opt/stack/data/cinder/conversion/5d769909-a048-44b8-be91-23e657b380b0.temp_image.556aea60-2c2b-4217-8c03-2373c7257731k9fz5cvi.img" returned: 0 in 5.138s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:31 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bb3a85-b66b-4de6-95df-d0ca7bec8dbe]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:34:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-32602b2f-fa56-4372-9ac2-e1cc523f8dab tempest-VolumesActionsTest-781154880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:31 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 Jul 13 20:34:31 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:31 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-32602b2f-fa56-4372-9ac2-e1cc523f8dab tempest-VolumesActionsTest-781154880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0" returned: 0 in 0.573s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:31 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-32602b2f-fa56-4372-9ac2-e1cc523f8dab tempest-VolumesActionsTest-781154880 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0, size 1024.00 MB, duration 5.14 sec, destination /opt/stack/data/cinder/conversion/5d769909-a048-44b8-be91-23e657b380b0.temp_image.556aea60-2c2b-4217-8c03-2373c7257731k9fz5cvi.img {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:34:31 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-32602b2f-fa56-4372-9ac2-e1cc523f8dab tempest-VolumesActionsTest-781154880 None] Converted 1024.00 MB image at 199.26 MB/s Jul 13 20:34:31 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-32602b2f-fa56-4372-9ac2-e1cc523f8dab tempest-VolumesActionsTest-781154880 None] 556aea60-2c2b-4217-8c03-2373c7257731 was raw, no need to convert to raw {{(pid=87269) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 13 20:34:38 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:34:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Flow 'volume_create_manager' (2a05a1e1-d4ab-4ed1-8d7f-0af1806aa5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:34:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37241d06-a04b-40ae-92e4-75ccaf744fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37241d06-a04b-40ae-92e4-75ccaf744fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-144020721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86870818-dcc9-47f9-915e-95c0d2dc07b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4f2139a0ae497bbdc9cf2dfea763cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:34:39Z,use_quota=True,user_id='bf167d5669904044bdafd58286e806c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5362041-a755-46b3-8469-2b66eac40221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5362041-a755-46b3-8469-2b66eac40221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a694cdcc-5bf8-410b-8da6-b1d68d7e7254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a694cdcc-5bf8-410b-8da6-b1d68d7e7254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86870818-dcc9-47f9-915e-95c0d2dc07b1', 'volume_name': 'volume-86870818-dcc9-47f9-915e-95c0d2dc07b1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d69a4d-9867-44a5-a8aa-4c5de1f19e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d69a4d-9867-44a5-a8aa-4c5de1f19e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:34:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139317b9-6cf4-4730-851c-f1d7db8967bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:34:38 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Volume 86870818-dcc9-47f9-915e-95c0d2dc07b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86870818-dcc9-47f9-915e-95c0d2dc07b1', 'volume_size': 1} Jul 13 20:34:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:34:48 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=44,cinder:UPDATE=42,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:34:48 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=37,cinder:SELECT=36,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-32602b2f-fa56-4372-9ac2-e1cc523f8dab tempest-VolumesActionsTest-781154880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.135s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-32602b2f-fa56-4372-9ac2-e1cc523f8dab tempest-VolumesActionsTest-781154880 None] Uploaded volume to glance image-id: 556aea60-2c2b-4217-8c03-2373c7257731. {{(pid=87269) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 30.918s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "cinder-quobyte-20558d22-ebb6-4aab-980b-c35b3caf13ba-886d7efa-042a-4927-ba7b-03ae003a762e" by "_create_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:34:56 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-32602b2f-fa56-4372-9ac2-e1cc523f8dab tempest-VolumesActionsTest-781154880 None] Copy volume to image completed successfully. Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-20558d22-ebb6-4aab-980b-c35b3caf13ba-886d7efa-042a-4927-ba7b-03ae003a762e" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Creating volume 886d7efa-042a-4927-ba7b-03ae003a762e from snapshot 20558d22-ebb6-4aab-980b-c35b3caf13ba {{(pid=87269) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "cinder-quobyte-886d7efa-042a-4927-ba7b-03ae003a762e" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-886d7efa-042a-4927-ba7b-03ae003a762e" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] snapshot: 20558d22-ebb6-4aab-980b-c35b3caf13ba, volume: 886d7efa-042a-4927-ba7b-03ae003a762e, {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f558ea18-8207-47dc-9b3a-721753293f83]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:56 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba Jul 13 20:34:56 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:56 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba" returned: 0 in 0.499s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49325195-d1d9-444f-9c79-ab7c82acd8fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc33ee8e-56ae-44b2-8faa-f592bcd3bceb]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:34:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:56 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc Jul 13 20:34:56 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:57 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Jul 13 20:34:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc" returned: 0 in 0.616s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:34:57 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Path /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-886d7efa-042a-4927-ba7b-03ae003a762e not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 20:34:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-886d7efa-042a-4927-ba7b-03ae003a762e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:34:57 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-886d7efa-042a-4927-ba7b-03ae003a762e Jul 13 20:34:57 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:34:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:03 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-886d7efa-042a-4927-ba7b-03ae003a762e" returned: 0 in 6.080s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:03 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e886e1-c7f4-43d8-b1af-63bb87d913e3]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:03 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc Jul 13 20:35:03 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:03 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc" returned: 0 in 0.523s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:03 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-886d7efa-042a-4927-ba7b-03ae003a762e {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:35:03 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Converted 1024.00 MB image at 168.38 MB/s Jul 13 20:35:03 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-886d7efa-042a-4927-ba7b-03ae003a762e is being set with open permissions: ugo+rw: NotImplementedError Jul 13 20:35:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-886d7efa-042a-4927-ba7b-03ae003a762e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:04 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-886d7efa-042a-4927-ba7b-03ae003a762e Jul 13 20:35:04 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:04 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-886d7efa-042a-4927-ba7b-03ae003a762e" returned: 0 in 0.262s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-886d7efa-042a-4927-ba7b-03ae003a762e" released by "_copy_volume_from_snapshot" :: held 8.102s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-20558d22-ebb6-4aab-980b-c35b3caf13ba-886d7efa-042a-4927-ba7b-03ae003a762e" released by "_create_volume_from_snapshot" :: held 8.138s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.166s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.472s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-144020721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86870818-dcc9-47f9-915e-95c0d2dc07b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4f2139a0ae497bbdc9cf2dfea763cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:34:39Z,use_quota=True,user_id='bf167d5669904044bdafd58286e806c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:35:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Creating volume 86870818-dcc9-47f9-915e-95c0d2dc07b1 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:35:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:35:04 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:35:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-86870818-dcc9-47f9-915e-95c0d2dc07b1 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:04 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-86870818-dcc9-47f9-915e-95c0d2dc07b1 1073741824 Jul 13 20:35:04 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0ffcab41-cf06-4960-9dae-5a591bb4d420 tempest-GroupSnapshotsTest-1740638669 None] Create group from source-snapshot-b4c4f5b0-cf51-458a-92aa-58d5c6503b64 completed successfully. Jul 13 20:35:04 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-86870818-dcc9-47f9-915e-95c0d2dc07b1 1073741824" returned: 0 in 0.446s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-86870818-dcc9-47f9-915e-95c0d2dc07b1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:04 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-86870818-dcc9-47f9-915e-95c0d2dc07b1 Jul 13 20:35:04 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:04 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-86870818-dcc9-47f9-915e-95c0d2dc07b1" returned: 0 in 0.248s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:35:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 7.175s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139317b9-6cf4-4730-851c-f1d7db8967bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86870818-dcc9-47f9-915e-95c0d2dc07b1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b923b083-a6b0-4717-8023-2e87f258f9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[600c4112-b5ed-4918-8f6e-03e77cff5516]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Volume volume-86870818-dcc9-47f9-915e-95c0d2dc07b1 (86870818-dcc9-47f9-915e-95c0d2dc07b1): created successfully Jul 13 20:35:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b923b083-a6b0-4717-8023-2e87f258f9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Flow 'volume_create_manager' (2a05a1e1-d4ab-4ed1-8d7f-0af1806aa5d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-37d1c29f-c74a-40b9-8197-70ad9c7f9792 tempest-VolumesTransfersV357Test-1455367577 None] Created volume successfully. Jul 13 20:35:05 devstack sudo[93400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 Jul 13 20:35:05 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:05 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0" returned: 0 in 0.465s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8afa69-3962-4d4d-834f-cd0ffcfa0a3b]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:05 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 Jul 13 20:35:05 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "cinder-quobyte-886d7efa-042a-4927-ba7b-03ae003a762e" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-886d7efa-042a-4927-ba7b-03ae003a762e" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82e6abd-cf0a-42a2-abc7-122c51368622]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-886d7efa-042a-4927-ba7b-03ae003a762e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:06 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-886d7efa-042a-4927-ba7b-03ae003a762e Jul 13 20:35:06 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:06 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0" returned: 0 in 0.570s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 /opt/stack/data/cinder/conversion/5d769909-a048-44b8-be91-23e657b380b0.temp_image.749bc4e4-445e-4adc-b781-1f33a220ab1daw8pvuuw.img {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:06 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 /opt/stack/data/cinder/conversion/5d769909-a048-44b8-be91-23e657b380b0.temp_image.749bc4e4-445e-4adc-b781-1f33a220ab1daw8pvuuw.img Jul 13 20:35:06 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:06 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-886d7efa-042a-4927-ba7b-03ae003a762e" returned: 0 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-886d7efa-042a-4927-ba7b-03ae003a762e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:06 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-886d7efa-042a-4927-ba7b-03ae003a762e Jul 13 20:35:06 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-dfc8b8fb-5a96-42c6-86e5-64cdeb160ef8 tempest-VolumesTransfersV357Test-859621555 None] Transfer volume completed successfully. Jul 13 20:35:06 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-886d7efa-042a-4927-ba7b-03ae003a762e" returned: 0 in 0.633s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-886d7efa-042a-4927-ba7b-03ae003a762e" released by "delete_volume" :: held 1.106s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:07 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] Created reservations ['f0cfeeae-77b7-43f4-8b41-2c33b3b4a87a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:35:07 devstack cinder-volume[87269]: WARNING cinder.quota [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1364784856 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1364784856, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:35:07 devstack cinder-volume[87269]: WARNING cinder.quota [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1364784856 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1364784856, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:35:07 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] Created reservations ['12281830-7a6c-4a6c-8263-4a8b85511dba', 'ae9f3d19-774c-43dd-8ba1-d55616582f0a', '0c10a131-2dd6-4aae-9fdb-9c55a67c16e7', '42c3a15d-8507-4a34-ab9c-166a70ef077c'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:35:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:08 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:35:08 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] Acquiring lock "cinder-86870818-dcc9-47f9-915e-95c0d2dc07b1-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] Lock "cinder-86870818-dcc9-47f9-915e-95c0d2dc07b1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] Acquiring lock "cinder-quobyte-86870818-dcc9-47f9-915e-95c0d2dc07b1" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] Lock "cinder-quobyte-86870818-dcc9-47f9-915e-95c0d2dc07b1" acquired by "delete_volume" :: waited 0.094s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:08 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d688768e-1e89-4875-9c99-2b0aed231f21]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-86870818-dcc9-47f9-915e-95c0d2dc07b1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:08 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.897s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:08 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:35:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-29e3878d-8cc6-4b74-b91a-09aa5a0af0ca tempest-GroupSnapshotsTest-1740638669 None] Delete group completed successfully. Jul 13 20:35:09 devstack sudo[93435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-86870818-dcc9-47f9-915e-95c0d2dc07b1 Jul 13 20:35:09 devstack sudo[93435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] group_snapshot b4c4f5b0-cf51-458a-92aa-58d5c6503b64: deleting Jul 13 20:35:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] group_snapshot b4c4f5b0-cf51-458a-92aa-58d5c6503b64: deleting {{(pid=87269) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 13 20:35:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "cinder-quobyte-49325195-d1d9-444f-9c79-ab7c82acd8fc" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-49325195-d1d9-444f-9c79-ab7c82acd8fc" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "cinder-quobyte-20558d22-ebb6-4aab-980b-c35b3caf13ba" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-20558d22-ebb6-4aab-980b-c35b3caf13ba" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] Deleting offline snapshot 20558d22-ebb6-4aab-980b-c35b3caf13ba of volume 49325195-d1d9-444f-9c79-ab7c82acd8fc {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:35:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] snapshot_file for this snap is: volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:35:09 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a61194a-1254-4cd2-bf86-ad1e09d510d9]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:09 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba Jul 13 20:35:09 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:09 devstack sudo[93435]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-86870818-dcc9-47f9-915e-95c0d2dc07b1" returned: 0 in 1.083s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-86870818-dcc9-47f9-915e-95c0d2dc07b1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:09 devstack sudo[93462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-86870818-dcc9-47f9-915e-95c0d2dc07b1 Jul 13 20:35:09 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:10 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba" returned: 0 in 0.791s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49325195-d1d9-444f-9c79-ab7c82acd8fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:35:10 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-86870818-dcc9-47f9-915e-95c0d2dc07b1" returned: 0 in 0.579s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:10 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b09b079-cd1d-4bcd-b4c0-43d8afd54131]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] Lock "cinder-quobyte-86870818-dcc9-47f9-915e-95c0d2dc07b1" released by "delete_volume" :: held 1.826s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:10 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] Created reservations ['00732092-7258-49fd-9a75-51d402763b47', '1371e9cf-c320-4b18-969e-888375d845ed', '9378ffec-076b-4977-8f59-cebff82e0240', 'ff90c8b1-f3f8-4e26-9850-fb0eb1e8dcb7'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:35:10 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc Jul 13 20:35:10 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:10 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:35:10 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:11 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc" returned: 0 in 0.976s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:11 devstack sudo[93476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba Jul 13 20:35:11 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:11 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.722s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:11 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:35:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] Deleted volume successfully. Jul 13 20:35:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-00a975a0-d5c8-45c3-8ac4-8ca9531cddf6 tempest-VolumesTransfersV357Test-256273944 None] Lock "cinder-86870818-dcc9-47f9-915e-95c0d2dc07b1-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:12 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 /opt/stack/data/cinder/conversion/5d769909-a048-44b8-be91-23e657b380b0.temp_image.749bc4e4-445e-4adc-b781-1f33a220ab1daw8pvuuw.img" returned: 0 in 6.149s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:12 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[657d4e1b-a0fe-4f30-88e2-a41a4f8137a5]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba" returned: 0 in 0.817s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:12 devstack sudo[93482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba Jul 13 20:35:12 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Flow 'volume_create_manager' (a6c22c2f-1a36-4061-9345-8bec8c5750c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0875ad69-e2f3-4bb5-a2eb-d937475c2674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:12 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 Jul 13 20:35:12 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0875ad69-e2f3-4bb5-a2eb-d937475c2674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2072396335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36cfe6c2-d171-4de2-9a5a-d8df6031fd86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4f2139a0ae497bbdc9cf2dfea763cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:12Z,use_quota=True,user_id='bf167d5669904044bdafd58286e806c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0348d1-f172-410b-a781-3d36cf0ecece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0348d1-f172-410b-a781-3d36cf0ecece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feefc5f9-2ec6-4dc8-856d-c870d89f27db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feefc5f9-2ec6-4dc8-856d-c870d89f27db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36cfe6c2-d171-4de2-9a5a-d8df6031fd86', 'volume_name': 'volume-36cfe6c2-d171-4de2-9a5a-d8df6031fd86', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7f45a4-7ebb-4762-9c7b-7ab73835e14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7f45a4-7ebb-4762-9c7b-7ab73835e14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612ea681-a002-4b5a-9051-7e892ed47ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:12 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Volume 36cfe6c2-d171-4de2-9a5a-d8df6031fd86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36cfe6c2-d171-4de2-9a5a-d8df6031fd86', 'volume_size': 1} Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:12 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc.20558d22-ebb6-4aab-980b-c35b3caf13ba" returned: 0 in 0.248s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-20558d22-ebb6-4aab-980b-c35b3caf13ba" released by "_delete_snapshot" :: held 3.048s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-49325195-d1d9-444f-9c79-ab7c82acd8fc" released by "delete_snapshot" :: held 3.112s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:12 devstack cinder-volume[87269]: WARNING cinder.quota [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1364784856 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1364784856, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] Created reservations ['6e2647e0-ff34-45ae-bff3-a274a0e3cdba', 'fb2dfda6-2b53-4bde-8e28-56602c505b30', 'f83efddd-c0aa-490b-ade0-739691f2a67e', '3647320e-4222-493f-a078-042d04e01355'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:35:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-37200626-ee13-4a35-8ac3-8e64a341d1f4 tempest-GroupSnapshotsTest-1740638669 None] group_snapshot b4c4f5b0-cf51-458a-92aa-58d5c6503b64: deleted successfully Jul 13 20:35:12 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0" returned: 0 in 0.546s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/conversion/5d769909-a048-44b8-be91-23e657b380b0.temp_image.749bc4e4-445e-4adc-b781-1f33a220ab1daw8pvuuw.img {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:35:12 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] Converted 1024.00 MB image at 166.50 MB/s Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] 749bc4e4-445e-4adc-b781-1f33a220ab1d was raw, converting to qcow2 {{(pid=87269) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb852cf-5c2e-4f52-824a-6146230c1162]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5d769909-a048-44b8-be91-23e657b380b0.temp_image.749bc4e4-445e-4adc-b781-1f33a220ab1daw8pvuuw.img {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:12 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5d769909-a048-44b8-be91-23e657b380b0.temp_image.749bc4e4-445e-4adc-b781-1f33a220ab1daw8pvuuw.img Jul 13 20:35:12 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:13 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5d769909-a048-44b8-be91-23e657b380b0.temp_image.749bc4e4-445e-4adc-b781-1f33a220ab1daw8pvuuw.img" returned: 0 in 0.313s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5d769909-a048-44b8-be91-23e657b380b0.temp_image.749bc4e4-445e-4adc-b781-1f33a220ab1daw8pvuuw.img {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:13 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5d769909-a048-44b8-be91-23e657b380b0.temp_image.749bc4e4-445e-4adc-b781-1f33a220ab1daw8pvuuw.img Jul 13 20:35:13 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8281a391-8cea-4950-8ed9-7530a41da5e8 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "cinder-quobyte-49325195-d1d9-444f-9c79-ab7c82acd8fc" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8281a391-8cea-4950-8ed9-7530a41da5e8 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-49325195-d1d9-444f-9c79-ab7c82acd8fc" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:13 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5d769909-a048-44b8-be91-23e657b380b0.temp_image.749bc4e4-445e-4adc-b781-1f33a220ab1daw8pvuuw.img" returned: 1 in 0.334s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5d769909-a048-44b8-be91-23e657b380b0.temp_image.749bc4e4-445e-4adc-b781-1f33a220ab1daw8pvuuw.img' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:35:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5d769909-a048-44b8-be91-23e657b380b0.temp_image.749bc4e4-445e-4adc-b781-1f33a220ab1daw8pvuuw.img /opt/stack/data/cinder/conversion/vol_upload_w9j97ic2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:13 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[76897831-912d-4c1b-8bdd-718d1ef82bf3]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8281a391-8cea-4950-8ed9-7530a41da5e8 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:13 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5d769909-a048-44b8-be91-23e657b380b0.temp_image.749bc4e4-445e-4adc-b781-1f33a220ab1daw8pvuuw.img /opt/stack/data/cinder/conversion/vol_upload_w9j97ic2 Jul 13 20:35:13 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:13 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc Jul 13 20:35:13 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:13 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5d769909-a048-44b8-be91-23e657b380b0.temp_image.749bc4e4-445e-4adc-b781-1f33a220ab1daw8pvuuw.img /opt/stack/data/cinder/conversion/vol_upload_w9j97ic2" returned: 0 in 0.268s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:13 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] Image conversion details: src /opt/stack/data/cinder/conversion/5d769909-a048-44b8-be91-23e657b380b0.temp_image.749bc4e4-445e-4adc-b781-1f33a220ab1daw8pvuuw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_w9j97ic2 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:35:13 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 13 20:35:13 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0d8db8-c235-4468-aa4e-af53df5462a8]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w9j97ic2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:13 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8281a391-8cea-4950-8ed9-7530a41da5e8 tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc" returned: 0 in 0.353s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8281a391-8cea-4950-8ed9-7530a41da5e8 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:13 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w9j97ic2 Jul 13 20:35:13 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:13 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc Jul 13 20:35:13 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:14 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w9j97ic2" returned: 0 in 0.328s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:14 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8281a391-8cea-4950-8ed9-7530a41da5e8 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49325195-d1d9-444f-9c79-ab7c82acd8fc" returned: 0 in 0.245s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8281a391-8cea-4950-8ed9-7530a41da5e8 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-49325195-d1d9-444f-9c79-ab7c82acd8fc" released by "delete_volume" :: held 0.658s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:14 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-8281a391-8cea-4950-8ed9-7530a41da5e8 tempest-GroupSnapshotsTest-1740638669 None] Created reservations ['58c030b6-d653-4fea-8b6d-d4c3acacabb0'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:35:14 devstack cinder-volume[87269]: WARNING cinder.db.api [None req-8281a391-8cea-4950-8ed9-7530a41da5e8 tempest-GroupSnapshotsTest-1740638669 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1364784856'] Jul 13 20:35:14 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-8281a391-8cea-4950-8ed9-7530a41da5e8 tempest-GroupSnapshotsTest-1740638669 None] Created reservations ['1a731eee-1a46-4fe3-87bb-6bf71ed34d7b', '9fefdc2e-77ab-46f9-9051-b58256a7bda0', 'bd0b6f0c-c6a9-422a-8ca7-9004c1f55324', 'e7c859f3-de30-4452-99df-59cc19bb5de9'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:35:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8281a391-8cea-4950-8ed9-7530a41da5e8 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8281a391-8cea-4950-8ed9-7530a41da5e8 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8281a391-8cea-4950-8ed9-7530a41da5e8 tempest-GroupSnapshotsTest-1740638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8281a391-8cea-4950-8ed9-7530a41da5e8 tempest-GroupSnapshotsTest-1740638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8281a391-8cea-4950-8ed9-7530a41da5e8 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8281a391-8cea-4950-8ed9-7530a41da5e8 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:14 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:35:14 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:14 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8281a391-8cea-4950-8ed9-7530a41da5e8 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.278s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:14 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-8281a391-8cea-4950-8ed9-7530a41da5e8 tempest-GroupSnapshotsTest-1740638669 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:35:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8281a391-8cea-4950-8ed9-7530a41da5e8 tempest-GroupSnapshotsTest-1740638669 None] Delete group completed successfully. Jul 13 20:35:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b9490d43-d686-4e7b-b1e7-347951b519dd tempest-GroupSnapshotsTest-1740638669 None] Group tempest-GroupSnapshotsTest-Group-1745005087: creating Jul 13 20:35:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b9490d43-d686-4e7b-b1e7-347951b519dd tempest-GroupSnapshotsTest-1740638669 None] Group tempest-GroupSnapshotsTest-Group-1745005087: created successfully Jul 13 20:35:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b9490d43-d686-4e7b-b1e7-347951b519dd tempest-GroupSnapshotsTest-1740638669 None] Create group completed successfully. Jul 13 20:35:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.451s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] Uploaded volume to glance image-id: 749bc4e4-445e-4adc-b781-1f33a220ab1d. {{(pid=87269) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 13 20:35:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.050s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2072396335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36cfe6c2-d171-4de2-9a5a-d8df6031fd86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4f2139a0ae497bbdc9cf2dfea763cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:12Z,use_quota=True,user_id='bf167d5669904044bdafd58286e806c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:35:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Creating volume 36cfe6c2-d171-4de2-9a5a-d8df6031fd86 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:35:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:35:15 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:35:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-36cfe6c2-d171-4de2-9a5a-d8df6031fd86 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:15 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-36cfe6c2-d171-4de2-9a5a-d8df6031fd86 1073741824 Jul 13 20:35:15 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7d39082f-683a-438a-a8d4-fbd365f1f9e3 tempest-VolumesActionsTest-781154880 None] Copy volume to image completed successfully. Jul 13 20:35:15 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-36cfe6c2-d171-4de2-9a5a-d8df6031fd86 1073741824" returned: 0 in 0.453s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-36cfe6c2-d171-4de2-9a5a-d8df6031fd86 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:15 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-36cfe6c2-d171-4de2-9a5a-d8df6031fd86 Jul 13 20:35:15 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:16 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-36cfe6c2-d171-4de2-9a5a-d8df6031fd86" returned: 0 in 0.265s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612ea681-a002-4b5a-9051-7e892ed47ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36cfe6c2-d171-4de2-9a5a-d8df6031fd86', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3c81ff-ee30-49db-8cd9-54e437f88f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:16 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Volume volume-36cfe6c2-d171-4de2-9a5a-d8df6031fd86 (36cfe6c2-d171-4de2-9a5a-d8df6031fd86): created successfully Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3c81ff-ee30-49db-8cd9-54e437f88f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Flow 'volume_create_manager' (a6c22c2f-1a36-4061-9345-8bec8c5750c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8bcb5887-f1cd-4ba4-a63f-ff0b59463e3d tempest-VolumesTransfersV357Test-1455367577 None] Created volume successfully. Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Flow 'volume_create_manager' (b665bca1-fa64-46a4-9126-3479dda6598f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094f3038-f14a-4c24-a976-8ecbe02bc439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094f3038-f14a-4c24-a976-8ecbe02bc439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-903448311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ee218538-0a4b-4103-b248-d6d5bfd9e483,host='devstack@QuobyteHD#QuobyteHD',id=9f816c79-1ee0-42f1-b99a-c58dd9f6775c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92748ca3e6bc43c089ea60f8f0c1bb34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:17Z,use_quota=True,user_id='50c969f9be054515ae851ed4cdca2a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(184caca3-49fc-496c-bec7-fe9c4aaadef4),volume_type_id=184caca3-49fc-496c-bec7-fe9c4aaadef4)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c437dd9-4de3-4210-8415-f62820814a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c437dd9-4de3-4210-8415-f62820814a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c0f6a3-bdf1-4c3c-92aa-1923975d1ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c0f6a3-bdf1-4c3c-92aa-1923975d1ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f816c79-1ee0-42f1-b99a-c58dd9f6775c', 'volume_name': 'volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27333d95-9cc6-4464-a3a6-1da5d220305a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27333d95-9cc6-4464-a3a6-1da5d220305a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3b0630-ec3d-4a78-8327-f60f20654b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:16 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Volume 9f816c79-1ee0-42f1-b99a-c58dd9f6775c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c', 'volume_size': 1} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ee218538-0a4b-4103-b248-d6d5bfd9e483,created_at=2026-07-13T18:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-903448311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ee218538-0a4b-4103-b248-d6d5bfd9e483,host='devstack@QuobyteHD#QuobyteHD',id=9f816c79-1ee0-42f1-b99a-c58dd9f6775c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92748ca3e6bc43c089ea60f8f0c1bb34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:17Z,use_quota=True,user_id='50c969f9be054515ae851ed4cdca2a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(184caca3-49fc-496c-bec7-fe9c4aaadef4),volume_type_id=184caca3-49fc-496c-bec7-fe9c4aaadef4)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Creating volume 9f816c79-1ee0-42f1-b99a-c58dd9f6775c {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:35:16 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] Acquiring lock "cinder-36cfe6c2-d171-4de2-9a5a-d8df6031fd86-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:16 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c 1073741824 Jul 13 20:35:16 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] Lock "cinder-36cfe6c2-d171-4de2-9a5a-d8df6031fd86-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] Acquiring lock "cinder-quobyte-36cfe6c2-d171-4de2-9a5a-d8df6031fd86" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] Lock "cinder-quobyte-36cfe6c2-d171-4de2-9a5a-d8df6031fd86" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[941d9646-1097-44d2-97c7-b3e742675e49]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-36cfe6c2-d171-4de2-9a5a-d8df6031fd86 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] Acquiring lock "cinder-5d769909-a048-44b8-be91-23e657b380b0-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] Lock "cinder-5d769909-a048-44b8-be91-23e657b380b0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] Acquiring lock "cinder-quobyte-5d769909-a048-44b8-be91-23e657b380b0" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:17 devstack sudo[93534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-36cfe6c2-d171-4de2-9a5a-d8df6031fd86 Jul 13 20:35:17 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] Lock "cinder-quobyte-5d769909-a048-44b8-be91-23e657b380b0" acquired by "delete_volume" :: waited 0.040s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[80605023-e78a-4095-9e80-d582379b1fb5]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:17 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 Jul 13 20:35:17 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:17 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:17 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-36cfe6c2-d171-4de2-9a5a-d8df6031fd86" returned: 0 in 0.462s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-36cfe6c2-d171-4de2-9a5a-d8df6031fd86 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c 1073741824" returned: 0 in 0.663s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:17 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-36cfe6c2-d171-4de2-9a5a-d8df6031fd86 Jul 13 20:35:17 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:17 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c Jul 13 20:35:17 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:17 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0" returned: 0 in 0.457s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:17 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0 Jul 13 20:35:17 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:17 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-36cfe6c2-d171-4de2-9a5a-d8df6031fd86" returned: 0 in 0.295s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] Lock "cinder-quobyte-36cfe6c2-d171-4de2-9a5a-d8df6031fd86" released by "delete_volume" :: held 0.826s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:17 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c" returned: 0 in 0.290s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3b0630-ec3d-4a78-8327-f60f20654b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe912df-7e62-43f5-8fcb-a37804e44da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:17 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Volume volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c (9f816c79-1ee0-42f1-b99a-c58dd9f6775c): created successfully Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe912df-7e62-43f5-8fcb-a37804e44da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Flow 'volume_create_manager' (b665bca1-fa64-46a4-9126-3479dda6598f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a1f26565-0d32-4e27-a910-7766fc1727c9 tempest-GroupSnapshotsTest-1740638669 None] Created volume successfully. Jul 13 20:35:17 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] Created reservations ['bccfa47f-e119-4388-9b09-5fceb419f159', 'e9f23afb-e621-41aa-a1cd-6e56a6e4d9cc', 'fcaf4280-ca9b-4905-9814-78b219a8f0a8', 'c5731f84-f9cb-4b99-ae95-b32e3edd36fd'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:18 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d769909-a048-44b8-be91-23e657b380b0" returned: 0 in 0.370s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] Lock "cinder-quobyte-5d769909-a048-44b8-be91-23e657b380b0" released by "delete_volume" :: held 0.874s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:18 devstack sudo[93557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:35:18 devstack sudo[93557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] Created reservations ['5d507718-70c5-4edf-884f-233131a4d555', 'ee02853e-7c8c-408a-abab-0053d7624e96', '86393f7e-f88a-4968-ab26-804793a2f6d9', 'da794f2c-32bc-4cf4-8f7a-5c83b93f1aa1'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:18 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:35:18 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:18 devstack sudo[93557]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.495s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:35:18 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] Deleted volume successfully. Jul 13 20:35:18 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-028c9670-7c45-47d8-b0b5-0ef02719e410 tempest-VolumesTransfersV357Test-256273944 None] Lock "cinder-36cfe6c2-d171-4de2-9a5a-d8df6031fd86-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.369s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:35:18 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] Deleted volume successfully. Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d213dc02-671d-45c6-8d04-b220a400a2fe tempest-VolumesActionsTest-781154880 None] Lock "cinder-5d769909-a048-44b8-be91-23e657b380b0-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:18 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:35:18 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:19 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.315s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:35:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:35:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:35:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Flow 'volume_create_manager' (8513423f-a26e-4687-9dcc-3fb2c57664d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29bfb19-1267-4dd5-9a77-6b816feeb4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29bfb19-1267-4dd5-9a77-6b816feeb4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2137206141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ee218538-0a4b-4103-b248-d6d5bfd9e483,host='devstack@QuobyteHD#QuobyteHD',id=1135306b-4356-4014-8090-15bb6af2ddf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92748ca3e6bc43c089ea60f8f0c1bb34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:20Z,use_quota=True,user_id='50c969f9be054515ae851ed4cdca2a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(184caca3-49fc-496c-bec7-fe9c4aaadef4),volume_type_id=184caca3-49fc-496c-bec7-fe9c4aaadef4)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d165c038-5891-4c56-8fd0-99aabee8533c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d165c038-5891-4c56-8fd0-99aabee8533c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009d8437-54c7-40a4-98ee-f5916dd82650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009d8437-54c7-40a4-98ee-f5916dd82650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1135306b-4356-4014-8090-15bb6af2ddf0', 'volume_name': 'volume-1135306b-4356-4014-8090-15bb6af2ddf0', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d579832-8254-485c-99d9-f90309e40900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d579832-8254-485c-99d9-f90309e40900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8b6107-ecaf-4bb9-ba66-724f44e88bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:20 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Volume 1135306b-4356-4014-8090-15bb6af2ddf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1135306b-4356-4014-8090-15bb6af2ddf0', 'volume_size': 1} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ee218538-0a4b-4103-b248-d6d5bfd9e483,created_at=2026-07-13T18:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2137206141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ee218538-0a4b-4103-b248-d6d5bfd9e483,host='devstack@QuobyteHD#QuobyteHD',id=1135306b-4356-4014-8090-15bb6af2ddf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92748ca3e6bc43c089ea60f8f0c1bb34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:20Z,use_quota=True,user_id='50c969f9be054515ae851ed4cdca2a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(184caca3-49fc-496c-bec7-fe9c4aaadef4),volume_type_id=184caca3-49fc-496c-bec7-fe9c4aaadef4)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Creating volume 1135306b-4356-4014-8090-15bb6af2ddf0 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:35:20 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:20 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0 1073741824 Jul 13 20:35:20 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:20 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0 1073741824" returned: 0 in 0.524s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:20 devstack sudo[93578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0 Jul 13 20:35:20 devstack sudo[93578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:21 devstack sudo[93578]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0" returned: 0 in 0.409s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8b6107-ecaf-4bb9-ba66-724f44e88bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1135306b-4356-4014-8090-15bb6af2ddf0', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b7058ce-c8f8-4d02-869c-649a71fdd234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:21 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Volume volume-1135306b-4356-4014-8090-15bb6af2ddf0 (1135306b-4356-4014-8090-15bb6af2ddf0): created successfully Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b7058ce-c8f8-4d02-869c-649a71fdd234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Flow 'volume_create_manager' (8513423f-a26e-4687-9dcc-3fb2c57664d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:21 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-339d886f-3128-47c7-8358-fcbf943e19a5 tempest-GroupSnapshotsTest-1740638669 None] Created volume successfully. Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Flow 'volume_create_manager' (72cbba89-d074-423e-915a-8107bbc0395b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08f9012-47d2-43c4-b4a8-920d60828da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08f9012-47d2-43c4-b4a8-920d60828da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-20382948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8636655f-dad0-4451-bdcb-51d873aa4bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417d64f0ac04ce0a740072984001d13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:21Z,use_quota=True,user_id='2459803a83964171b34a07956a8de14a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3432c3-debc-4ec7-b35a-af2f5bb62fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3432c3-debc-4ec7-b35a-af2f5bb62fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aecd531-7b7c-4270-9d81-f3da45993c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aecd531-7b7c-4270-9d81-f3da45993c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8636655f-dad0-4451-bdcb-51d873aa4bca', 'volume_name': 'volume-8636655f-dad0-4451-bdcb-51d873aa4bca', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6dfe6e8-bb2f-4791-bc17-a42052b5d764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6dfe6e8-bb2f-4791-bc17-a42052b5d764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d871530-c8a4-4cfb-9e57-1c31aa0661a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:21 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Volume 8636655f-dad0-4451-bdcb-51d873aa4bca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8636655f-dad0-4451-bdcb-51d873aa4bca', 'volume_size': 1} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-20382948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8636655f-dad0-4451-bdcb-51d873aa4bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417d64f0ac04ce0a740072984001d13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:21Z,use_quota=True,user_id='2459803a83964171b34a07956a8de14a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Creating volume 8636655f-dad0-4451-bdcb-51d873aa4bca {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:35:21 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8636655f-dad0-4451-bdcb-51d873aa4bca 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:21 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8636655f-dad0-4451-bdcb-51d873aa4bca 1073741824 Jul 13 20:35:21 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:21 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8636655f-dad0-4451-bdcb-51d873aa4bca 1073741824" returned: 0 in 0.569s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8636655f-dad0-4451-bdcb-51d873aa4bca {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:22 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8636655f-dad0-4451-bdcb-51d873aa4bca Jul 13 20:35:22 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:22 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8636655f-dad0-4451-bdcb-51d873aa4bca" returned: 0 in 0.400s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:35:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d871530-c8a4-4cfb-9e57-1c31aa0661a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8636655f-dad0-4451-bdcb-51d873aa4bca', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6160a799-ad71-42bd-b3a3-7e02abdf7186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:22 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Volume volume-8636655f-dad0-4451-bdcb-51d873aa4bca (8636655f-dad0-4451-bdcb-51d873aa4bca): created successfully Jul 13 20:35:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6160a799-ad71-42bd-b3a3-7e02abdf7186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Flow 'volume_create_manager' (72cbba89-d074-423e-915a-8107bbc0395b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6a1132af-4236-43eb-b148-e33c880935ae tempest-AttachVolumeShelveTestJSON-1079834049 None] Created volume successfully. Jul 13 20:35:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6630942d-5499-4b2f-b7da-bfaa8d4fb7a5 tempest-GroupSnapshotsTest-1740638669 None] Update group completed successfully. Jul 13 20:35:23 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-73c6fdf7-ad3c-48cc-b5b7-94afa64d57df tempest-GroupSnapshotsTest-1740638669 None] Update group completed successfully. Jul 13 20:35:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9333050c-1513-44a8-b798-931464ebfd1f tempest-GroupSnapshotsTest-1740638669 None] Update group completed successfully. Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Flow 'volume_create_manager' (69647877-dd41-45a6-a602-1b210c27bf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89358705-6a49-4007-9064-9cd8307f4970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89358705-6a49-4007-9064-9cd8307f4970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-44172532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecdec863-6f02-4a9e-bba4-26f01617a434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f058d49e8a4e42a5b8bf06a0c5bba147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:26Z,use_quota=True,user_id='bc3cd60c91d649448e721a7921c31584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94025d4c-733d-4cc2-b570-f7cd7e99ec67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94025d4c-733d-4cc2-b570-f7cd7e99ec67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c97038fa-91f4-478e-bccd-6e89092098e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c97038fa-91f4-478e-bccd-6e89092098e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecdec863-6f02-4a9e-bba4-26f01617a434', 'volume_name': 'volume-ecdec863-6f02-4a9e-bba4-26f01617a434', 'volume_size': 2}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5683ad-bc0a-407a-ab8f-ec67ad954993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5683ad-bc0a-407a-ab8f-ec67ad954993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee29eac-d3d0-42e4-9b4e-f34cef968eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:26 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Volume ecdec863-6f02-4a9e-bba4-26f01617a434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecdec863-6f02-4a9e-bba4-26f01617a434', 'volume_size': 2} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-44172532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecdec863-6f02-4a9e-bba4-26f01617a434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f058d49e8a4e42a5b8bf06a0c5bba147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:26Z,use_quota=True,user_id='bc3cd60c91d649448e721a7921c31584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Creating volume ecdec863-6f02-4a9e-bba4-26f01617a434 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:35:26 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:35:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ecdec863-6f02-4a9e-bba4-26f01617a434 2147483648 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:26 devstack sudo[93612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ecdec863-6f02-4a9e-bba4-26f01617a434 2147483648 Jul 13 20:35:26 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:26 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7c77a182-8ca6-4557-be3e-ce1ec5b33c78 tempest-GroupSnapshotsTest-1740638669 None] Update group completed successfully. Jul 13 20:35:27 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ecdec863-6f02-4a9e-bba4-26f01617a434 2147483648" returned: 0 in 0.728s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ecdec863-6f02-4a9e-bba4-26f01617a434 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:27 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ecdec863-6f02-4a9e-bba4-26f01617a434 Jul 13 20:35:27 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:27 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ecdec863-6f02-4a9e-bba4-26f01617a434" returned: 0 in 0.276s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:35:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee29eac-d3d0-42e4-9b4e-f34cef968eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecdec863-6f02-4a9e-bba4-26f01617a434', 'volume_size': 2}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18823ff1-cf50-4b5c-98b4-87c7dacb6e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:27 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Volume volume-ecdec863-6f02-4a9e-bba4-26f01617a434 (ecdec863-6f02-4a9e-bba4-26f01617a434): created successfully Jul 13 20:35:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18823ff1-cf50-4b5c-98b4-87c7dacb6e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Flow 'volume_create_manager' (69647877-dd41-45a6-a602-1b210c27bf9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:27 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b1eae048-8e1f-4dd1-b43e-13211fb94a2c tempest-VolumesCloneNegativeTest-1962230329 None] Created volume successfully. Jul 13 20:35:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] GroupSnapshot 9341e84a-5796-4c1d-8542-eaa5fde38d28: creating. Jul 13 20:35:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Group snapshot 9341e84a-5796-4c1d-8542-eaa5fde38d28: creating. {{(pid=87269) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 13 20:35:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Creating offline snapshot 45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f of volume 1135306b-4356-4014-8090-15bb6af2ddf0 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:35:28 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ca2d24-1767-4ae7-8bd0-de73764c4f43]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:28 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0 Jul 13 20:35:28 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] Acquiring lock "cinder-ecdec863-6f02-4a9e-bba4-26f01617a434-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] Lock "cinder-ecdec863-6f02-4a9e-bba4-26f01617a434-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] Acquiring lock "cinder-quobyte-ecdec863-6f02-4a9e-bba4-26f01617a434" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] Lock "cinder-quobyte-ecdec863-6f02-4a9e-bba4-26f01617a434" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:28 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef16321-890a-4772-9e65-d3cfa41b9d09]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ecdec863-6f02-4a9e-bba4-26f01617a434 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:28 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0" returned: 0 in 0.582s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:28 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f 1G Jul 13 20:35:28 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:28 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ecdec863-6f02-4a9e-bba4-26f01617a434 Jul 13 20:35:28 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:29 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ecdec863-6f02-4a9e-bba4-26f01617a434" returned: 0 in 0.570s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ecdec863-6f02-4a9e-bba4-26f01617a434 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:29 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ecdec863-6f02-4a9e-bba4-26f01617a434 Jul 13 20:35:29 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:29 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f 1G" returned: 0 in 0.649s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1135306b-4356-4014-8090-15bb6af2ddf0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:29 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1135306b-4356-4014-8090-15bb6af2ddf0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f Jul 13 20:35:29 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:29 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ecdec863-6f02-4a9e-bba4-26f01617a434" returned: 0 in 0.321s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] Lock "cinder-quobyte-ecdec863-6f02-4a9e-bba4-26f01617a434" released by "delete_volume" :: held 0.945s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:29 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] Created reservations ['04a8408a-55e0-407f-a9f5-51a19a5fc8a1', '42338570-a44b-43eb-8664-9e5d7d869d9d', '42c62560-31f0-47be-a0a4-e61fe0f8b800', 'ef887f8d-ff85-4914-8080-c2715f485465'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:35:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:29 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1135306b-4356-4014-8090-15bb6af2ddf0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f" returned: 0 in 0.385s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:29 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f is being set with open permissions: ugo+rw: NotImplementedError Jul 13 20:35:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:29 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:35:29 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:29 devstack sudo[93653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f Jul 13 20:35:29 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:30 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.415s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:30 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:35:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] Deleted volume successfully. Jul 13 20:35:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-535b3fdb-d818-4f2a-92dc-879f0d7f9c9b tempest-VolumesCloneNegativeTest-1962230329 None] Lock "cinder-ecdec863-6f02-4a9e-bba4-26f01617a434-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:30 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f" returned: 0 in 0.579s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:30 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.info Jul 13 20:35:30 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:30 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.info" returned: 0 in 0.305s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:30 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 13 20:35:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:30 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.info Jul 13 20:35:30 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:31 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.info" returned: 0 in 0.330s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.955s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Creating offline snapshot 9cf2ce36-a690-4f10-94a4-4d36bd218e2a of volume 9f816c79-1ee0-42f1-b99a-c58dd9f6775c {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:35:31 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b4bd9a-a17f-4a20-ab1a-0a595a9cbf29]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:31 devstack sudo[93663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c Jul 13 20:35:31 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:31 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c" returned: 0 in 0.395s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:31 devstack sudo[93668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a 1G Jul 13 20:35:31 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:32 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a 1G" returned: 0 in 0.524s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:32 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a Jul 13 20:35:32 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:32 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a" returned: 0 in 0.375s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:32 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a is being set with open permissions: ugo+rw: NotImplementedError Jul 13 20:35:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:32 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a Jul 13 20:35:32 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:32 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a" returned: 0 in 0.342s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:32 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.info Jul 13 20:35:32 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:33 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.info" returned: 0 in 0.300s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:33 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 13 20:35:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:33 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.info Jul 13 20:35:33 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:33 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.info" returned: 0 in 0.320s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.384s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:33 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-873c6a99-5f2f-4205-a79d-4002bc747a69 tempest-GroupSnapshotsTest-1740638669 None] group_snapshot 9341e84a-5796-4c1d-8542-eaa5fde38d28: created successfully Jul 13 20:35:34 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] group_snapshot 9341e84a-5796-4c1d-8542-eaa5fde38d28: deleting Jul 13 20:35:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] group_snapshot 9341e84a-5796-4c1d-8542-eaa5fde38d28: deleting {{(pid=87269) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 13 20:35:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "cinder-quobyte-1135306b-4356-4014-8090-15bb6af2ddf0" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-1135306b-4356-4014-8090-15bb6af2ddf0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "cinder-quobyte-45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Deleting offline snapshot 45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f of volume 1135306b-4356-4014-8090-15bb6af2ddf0 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:35:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] snapshot_file for this snap is: volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:35:35 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d99cac-327d-489b-b463-a28652bab87c]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:35 devstack sudo[93707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f Jul 13 20:35:35 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:35 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f" returned: 0 in 0.550s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1135306b-4356-4014-8090-15bb6af2ddf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:35:35 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:35:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Flow 'volume_create_manager' (cea9d54b-419e-4291-8f63-d7055a2639da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98bfeb2-c06c-4528-b007-8f02f5912d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:35 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e07a22-e1dc-4cbd-987e-ddccefd4639b]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98bfeb2-c06c-4528-b007-8f02f5912d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-739976119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8c23d2-306d-4cb2-95ec-57e5d427f868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc311a54b09a4bd08f2d2d9e70b4d476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:36Z,use_quota=True,user_id='0723147f0b664aadbebfa45a9e96d65b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23ddc63-c386-494a-8653-baba546f3461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23ddc63-c386-494a-8653-baba546f3461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299a58ab-9182-48b1-b4e8-a08c3922e21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:35 devstack cinder-volume[87269]: DEBUG cinder.image.glance [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Creating Keystone auth plugin from conf {{(pid=87269) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 13 20:35:35 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0 Jul 13 20:35:35 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299a58ab-9182-48b1-b4e8-a08c3922e21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da8c23d2-306d-4cb2-95ec-57e5d427f868', 'volume_name': 'volume-da8c23d2-306d-4cb2-95ec-57e5d427f868', 'volume_size': 1, 'image_id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6b4015e3a3db4a91ba2712f5d9c0002b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'created_at': datetime.datetime(2026, 7, 13, 18, 22, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5c85faa-ccd2-446c-ac1c-c871b5183834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9e0a49-55b1-44fa-9cb0-286cb48515ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9e0a49-55b1-44fa-9cb0-286cb48515ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2888bf6e-cfa1-4048-bcde-65bdec30da76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:36 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Volume da8c23d2-306d-4cb2-95ec-57e5d427f868: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da8c23d2-306d-4cb2-95ec-57e5d427f868', 'volume_size': 1, 'image_id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6b4015e3a3db4a91ba2712f5d9c0002b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'created_at': datetime.datetime(2026, 7, 13, 18, 22, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5c85faa-ccd2-446c-ac1c-c871b5183834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Trying to clone da8c23d2-306d-4cb2-95ec-57e5d427f868 from image a5c85faa-ccd2-446c-ac1c-c871b5183834 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}]). {{(pid=87269) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 13 20:35:36 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0" returned: 0 in 0.810s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:36 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f Jul 13 20:35:36 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Flow 'volume_create_manager' (a9e806e6-3ebe-46c0-91e4-e5d6d73c0db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae039947-7f8c-44db-9682-8e171f1c4f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae039947-7f8c-44db-9682-8e171f1c4f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-562530218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0376604d-48c1-4dde-a219-1c82166f30e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277c14ac956342e5ba41941e37eaf4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:37Z,use_quota=True,user_id='233d474065d746a0b561531396356a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc16a9e-2209-4716-9408-37134f537c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc16a9e-2209-4716-9408-37134f537c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f0985e-65df-4b72-a345-c28bf9e7d61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f0985e-65df-4b72-a345-c28bf9e7d61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0376604d-48c1-4dde-a219-1c82166f30e0', 'volume_name': 'volume-0376604d-48c1-4dde-a219-1c82166f30e0', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3ba084-6621-4846-9ffe-4d8f018f8e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3ba084-6621-4846-9ffe-4d8f018f8e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (393b5120-edb1-47a2-8370-8d8cf8af97b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:36 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Volume 0376604d-48c1-4dde-a219-1c82166f30e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0376604d-48c1-4dde-a219-1c82166f30e0', 'volume_size': 1} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-562530218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0376604d-48c1-4dde-a219-1c82166f30e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277c14ac956342e5ba41941e37eaf4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:37Z,use_quota=True,user_id='233d474065d746a0b561531396356a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Creating volume 0376604d-48c1-4dde-a219-1c82166f30e0 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:35:36 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:36 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0 1073741824 Jul 13 20:35:36 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_nhcjhyaadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 13 20:35:36 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Image download 20.69 MB at 20.69 MB/s Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6702aaef-b8d9-4d79-ae59-9fdc8bb81891]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_nhcjhyaadevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:36 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f" returned: 0 in 0.477s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:37 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f Jul 13 20:35:37 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:37 devstack sudo[93728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_nhcjhyaadevstack@QuobyteHD Jul 13 20:35:37 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:37 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0.45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f" returned: 0 in 0.298s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:37 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0 1073741824" returned: 0 in 0.545s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:37 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-45bb4ce8-bdbf-424e-9a71-e3fa2f83dc8f" released by "_delete_snapshot" :: held 2.334s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-bdc08243-42c2-4181-89ce-b26ff5b4b2bc req-3967b49b-c5ed-41db-8013-82f9b11c28d2 tempest-AttachVolumeShelveTestJSON-1079834049 None] No connector for attachment 0c5b3f52-4096-4176-b618-e0be84467cff; skipping storage backend terminate_connection call. {{(pid=87269) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-bdc08243-42c2-4181-89ce-b26ff5b4b2bc req-3967b49b-c5ed-41db-8013-82f9b11c28d2 tempest-AttachVolumeShelveTestJSON-1079834049 None] Deleting attachment 0c5b3f52-4096-4176-b618-e0be84467cff. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-1135306b-4356-4014-8090-15bb6af2ddf0" released by "delete_snapshot" :: held 2.367s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_nhcjhyaadevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Temporary image a5c85faa-ccd2-446c-ac1c-c871b5183834 is fetched for user 0723147f0b664aadbebfa45a9e96d65b. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "cinder-quobyte-9f816c79-1ee0-42f1-b99a-c58dd9f6775c" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-9f816c79-1ee0-42f1-b99a-c58dd9f6775c" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "cinder-quobyte-9cf2ce36-a690-4f10-94a4-4d36bd218e2a" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:37 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0 Jul 13 20:35:37 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-9cf2ce36-a690-4f10-94a4-4d36bd218e2a" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Deleting offline snapshot 9cf2ce36-a690-4f10-94a4-4d36bd218e2a of volume 9f816c79-1ee0-42f1-b99a-c58dd9f6775c {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] snapshot_file for this snap is: volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[60eeed19-00ca-4838-9d3c-d26f33ea4ccf]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a84252-293d-47e7-80a9-003e611b1e88]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_nhcjhyaadevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:37 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a Jul 13 20:35:37 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:37 devstack sudo[93743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_nhcjhyaadevstack@QuobyteHD Jul 13 20:35:37 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:37 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0" returned: 0 in 0.361s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (393b5120-edb1-47a2-8370-8d8cf8af97b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0376604d-48c1-4dde-a219-1c82166f30e0', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ce423c-5965-4ded-a0a6-49e25101fa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:37 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Volume volume-0376604d-48c1-4dde-a219-1c82166f30e0 (0376604d-48c1-4dde-a219-1c82166f30e0): created successfully Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ce423c-5965-4ded-a0a6-49e25101fa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Flow 'volume_create_manager' (a9e806e6-3ebe-46c0-91e4-e5d6d73c0db3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:37 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-15f8db3a-b678-434e-92d0-5960a4bbceb5 tempest-VolumesSnapshotTestJSON-233593282 None] Created volume successfully. Jul 13 20:35:37 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:37 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a" returned: 0 in 0.464s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_nhcjhyaadevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-739976119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8c23d2-306d-4cb2-95ec-57e5d427f868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc311a54b09a4bd08f2d2d9e70b4d476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:36Z,use_quota=True,user_id='0723147f0b664aadbebfa45a9e96d65b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Creating volume da8c23d2-306d-4cb2-95ec-57e5d427f868 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:35:38 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadf4977-4249-405a-bc0b-9aa00f431a95]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:38 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 1073741824 Jul 13 20:35:38 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:38 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c Jul 13 20:35:38 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:38 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c" returned: 0 in 0.400s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:38 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a Jul 13 20:35:38 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:38 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 1073741824" returned: 0 in 0.514s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:38 devstack sudo[93770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 Jul 13 20:35:38 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:38 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868" returned: 0 in 0.342s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:38 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a" returned: 0 in 0.514s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:38 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a Jul 13 20:35:38 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:38 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Attempting download of a5c85faa-ccd2-446c-ac1c-c871b5183834 ((None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}])) to volume da8c23d2-306d-4cb2-95ec-57e5d427f868. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ac369aa8-b7ad-4522-aa88-fd74daaed397 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ac369aa8-b7ad-4522-aa88-fd74daaed397 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ac369aa8-b7ad-4522-aa88-fd74daaed397 tempest-VolumesSnapshotTestJSON-233593282 None] Creating offline snapshot ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce of volume 0376604d-48c1-4dde-a219-1c82166f30e0 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[542f9233-0582-4c26-b2f9-62dc415f8250]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_4sqtwqmo {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b3fc9c-5867-4a73-b6b7-8c550e88672e]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac369aa8-b7ad-4522-aa88-fd74daaed397 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:39 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_4sqtwqmo Jul 13 20:35:39 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:39 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0 Jul 13 20:35:39 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:39 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c.9cf2ce36-a690-4f10-94a4-4d36bd218e2a" returned: 0 in 0.336s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-9cf2ce36-a690-4f10-94a4-4d36bd218e2a" released by "_delete_snapshot" :: held 1.866s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-9f816c79-1ee0-42f1-b99a-c58dd9f6775c" released by "delete_snapshot" :: held 1.923s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:39 devstack cinder-volume[87269]: WARNING cinder.quota [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-971041220 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-971041220, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:35:39 devstack cinder-volume[87269]: WARNING cinder.quota [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-971041220 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-971041220, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Created reservations ['64cada7d-464a-43dd-a956-08567dbf1f30', '365dd849-7628-4164-a287-acc9af856e13', '1a87fbda-6ef9-4a4d-9a08-530d54f9e603', '642c8ccd-5a3f-48e1-9790-4beacce705d3'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:35:39 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:39 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_4sqtwqmo" returned: 0 in 0.502s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_4sqtwqmo {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac369aa8-b7ad-4522-aa88-fd74daaed397 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0" returned: 0 in 0.508s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac369aa8-b7ad-4522-aa88-fd74daaed397 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:39 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce 1G Jul 13 20:35:39 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] Created reservations ['595fe799-12b3-44a1-8c54-48efe559ce7e', 'cc3108de-95cb-48e7-902c-cfc3657c409e', '9a49c0b2-079c-4412-9ded-b5b98c08dd90', 'b2c3bbc4-708c-4783-9094-d463b204dd8e'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:35:39 devstack sudo[93790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_4sqtwqmo Jul 13 20:35:39 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4861af8c-b864-4bb7-b214-31123990dcc3 tempest-GroupSnapshotsTest-1740638669 None] group_snapshot 9341e84a-5796-4c1d-8542-eaa5fde38d28: deleted successfully Jul 13 20:35:39 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_4sqtwqmo" returned: 1 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_4sqtwqmo' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee7d133-4aca-4629-bdfc-d344e322a8a1]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_nhcjhyaadevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:40 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac369aa8-b7ad-4522-aa88-fd74daaed397 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce 1G" returned: 0 in 0.484s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac369aa8-b7ad-4522-aa88-fd74daaed397 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0376604d-48c1-4dde-a219-1c82166f30e0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:40 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_nhcjhyaadevstack@QuobyteHD Jul 13 20:35:40 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:40 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0376604d-48c1-4dde-a219-1c82166f30e0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce Jul 13 20:35:40 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:40 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_nhcjhyaadevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:40 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] a5c85faa-ccd2-446c-ac1c-c871b5183834 was qcow2, converting to raw {{(pid=87269) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 13 20:35:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_nhcjhyaadevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:40 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_nhcjhyaadevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 Jul 13 20:35:40 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:40 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac369aa8-b7ad-4522-aa88-fd74daaed397 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0376604d-48c1-4dde-a219-1c82166f30e0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce" returned: 0 in 0.315s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:40 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-ac369aa8-b7ad-4522-aa88-fd74daaed397 tempest-VolumesSnapshotTestJSON-233593282 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce is being set with open permissions: ugo+rw Jul 13 20:35:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac369aa8-b7ad-4522-aa88-fd74daaed397 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:40 devstack sudo[93811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce Jul 13 20:35:40 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:40 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac369aa8-b7ad-4522-aa88-fd74daaed397 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce" returned: 0 in 0.310s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac369aa8-b7ad-4522-aa88-fd74daaed397 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:40 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.info Jul 13 20:35:40 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "cinder-quobyte-1135306b-4356-4014-8090-15bb6af2ddf0" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-1135306b-4356-4014-8090-15bb6af2ddf0" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:41 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac369aa8-b7ad-4522-aa88-fd74daaed397 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.info" returned: 0 in 0.467s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:41 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-ac369aa8-b7ad-4522-aa88-fd74daaed397 tempest-VolumesSnapshotTestJSON-233593282 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.info is being set with open permissions: ugo+rw Jul 13 20:35:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac369aa8-b7ad-4522-aa88-fd74daaed397 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:41 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae898934-8334-433e-9344-5eeb49572257]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:41 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.info Jul 13 20:35:41 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:41 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0 Jul 13 20:35:41 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:41 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac369aa8-b7ad-4522-aa88-fd74daaed397 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.info" returned: 0 in 0.303s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ac369aa8-b7ad-4522-aa88-fd74daaed397 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.548s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:41 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ac369aa8-b7ad-4522-aa88-fd74daaed397 tempest-VolumesSnapshotTestJSON-233593282 None] Create snapshot completed successfully Jul 13 20:35:41 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0" returned: 0 in 0.486s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:41 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0 Jul 13 20:35:41 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:42 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1135306b-4356-4014-8090-15bb6af2ddf0" returned: 0 in 0.454s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-1135306b-4356-4014-8090-15bb6af2ddf0" released by "delete_volume" :: held 1.083s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "cinder-quobyte-9f816c79-1ee0-42f1-b99a-c58dd9f6775c" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-9f816c79-1ee0-42f1-b99a-c58dd9f6775c" acquired by "delete_volume" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:42 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[812e5368-8125-432a-a75a-c46e27b22692]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:42 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c Jul 13 20:35:42 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:42 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_nhcjhyaadevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868" returned: 0 in 2.334s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:42 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_nhcjhyaadevstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:35:42 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Converted 112.00 MB image at 47.93 MB/s Jul 13 20:35:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:42 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 1G Jul 13 20:35:42 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-quobyte-0376604d-48c1-4dde-a219-1c82166f30e0" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-0376604d-48c1-4dde-a219-1c82166f30e0" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-quobyte-ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] Deleting offline snapshot ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce of volume 0376604d-48c1-4dde-a219-1c82166f30e0 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:35:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] snapshot_file for this snap is: volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:35:42 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[95478bea-2eab-460d-ae3f-70b5821f543e]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:43 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c" returned: 0 in 0.652s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:43 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 1G" returned: 0 in 0.403s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:43 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c Jul 13 20:35:43 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:43 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c88be0-93e3-409a-99f0-4e1ab16841b6]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:43 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce Jul 13 20:35:43 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:43 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 Jul 13 20:35:43 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:43 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9f816c79-1ee0-42f1-b99a-c58dd9f6775c" returned: 0 in 0.417s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-9f816c79-1ee0-42f1-b99a-c58dd9f6775c" released by "delete_volume" :: held 1.198s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:43 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce" returned: 0 in 0.612s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0376604d-48c1-4dde-a219-1c82166f30e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:35:43 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868" returned: 0 in 0.468s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:43 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1500d11a-d2c4-4071-86e5-9e583782dbf9]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:43 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Created reservations ['d6252994-ac00-40bd-b313-54627794d928'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:35:43 devstack cinder-volume[87269]: WARNING cinder.quota [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-971041220 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-971041220, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:35:43 devstack sudo[93897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0 Jul 13 20:35:43 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:43 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 Jul 13 20:35:43 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:43 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Created reservations ['2026c73e-21a3-46cf-9549-46856d92b19e', '50c95027-ea5a-4434-9410-f71267204248', '57b56e59-bdb2-4d0e-984f-4e721de9e4d9', '37fbe788-bd2d-4a8b-98f7-b9e8c66f0ba6'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Created reservations ['7b7e33f4-8ebb-44f7-a3ad-f2ad45103931', '5eed2804-3655-4027-91c3-3160a5ffe344', '042f2a2a-d491-419d-a521-e218bcdca073', '8732661f-fdd5-4f04-ade0-cc625f7473ed'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:35:44 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868" returned: 1 in 0.530s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Downloaded image a5c85faa-ccd2-446c-ac1c-c871b5183834 ((None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}])) to volume da8c23d2-306d-4cb2-95ec-57e5d427f868 successfully. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Temporary image a5c85faa-ccd2-446c-ac1c-c871b5183834 for user 0723147f0b664aadbebfa45a9e96d65b is deleted. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Marking volume da8c23d2-306d-4cb2-95ec-57e5d427f868 as bootable. {{(pid=87269) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 13 20:35:44 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0" returned: 0 in 0.543s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Copying metadata from image a5c85faa-ccd2-446c-ac1c-c871b5183834 to da8c23d2-306d-4cb2-95ec-57e5d427f868. {{(pid=87269) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Creating volume glance metadata for volume da8c23d2-306d-4cb2-95ec-57e5d427f868 backed by image a5c85faa-ccd2-446c-ac1c-c871b5183834 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87269) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 13 20:35:44 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce Jul 13 20:35:44 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:44 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:35:44 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2888bf6e-cfa1-4048-bcde-65bdec30da76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da8c23d2-306d-4cb2-95ec-57e5d427f868', 'volume_size': 1, 'image_id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6b4015e3a3db4a91ba2712f5d9c0002b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'created_at': datetime.datetime(2026, 7, 13, 18, 22, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5c85faa-ccd2-446c-ac1c-c871b5183834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a446a5a9-483e-4f94-833b-9d56990a1940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:44 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Volume volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 (da8c23d2-306d-4cb2-95ec-57e5d427f868): created successfully Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a446a5a9-483e-4f94-833b-9d56990a1940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Flow 'volume_create_manager' (cea9d54b-419e-4291-8f63-d7055a2639da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:44 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3dd921eb-2aa0-47a3-a957-10b40960809a tempest-VolumesExtendTest-1216259433 None] Created volume successfully. Jul 13 20:35:44 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.315s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:35:44 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-95863a0b-d6e6-446a-9e69-404e8ec7c9da tempest-GroupSnapshotsTest-1740638669 None] Delete group completed successfully. Jul 13 20:35:44 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce" returned: 0 in 0.419s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:44 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce Jul 13 20:35:44 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:44 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0.ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce" returned: 0 in 0.265s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce" released by "_delete_snapshot" :: held 1.999s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-0376604d-48c1-4dde-a219-1c82166f30e0" released by "delete_snapshot" :: held 2.031s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:44 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] Created reservations ['048d6f08-da16-4d7a-a55d-06abede78394', 'b86f00f9-9ece-4712-8981-398302fa4edd', '66335450-0f85-47aa-904d-d24869cbf790', '483155dd-dff5-4605-b1ed-09fdc1dc18a8'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:35:45 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] Delete snapshot completed successfully. Jul 13 20:35:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a30ed7e4-6348-4f4b-9a8a-3a09feb2bf24 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-ad80d633-dfea-4c9b-b0c4-55ab7aa2d5ce-delete_snapshot" released by "delete_snapshot" :: held 2.283s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cd28bd0c-0c86-4794-ba5e-80f61f1bb715 tempest-VolumesExtendTest-1216259433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cd28bd0c-0c86-4794-ba5e-80f61f1bb715 tempest-VolumesExtendTest-1216259433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a631aed2-49f2-44a6-864d-d9854b2d7503]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd28bd0c-0c86-4794-ba5e-80f61f1bb715 tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:45 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0e6ca358-f4f3-437f-b9bc-bc63053927a6 tempest-GroupSnapshotsTest-1740638669 None] Group tempest-GroupSnapshotsTest-Group-228462224: creating Jul 13 20:35:45 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0e6ca358-f4f3-437f-b9bc-bc63053927a6 tempest-GroupSnapshotsTest-1740638669 None] Group tempest-GroupSnapshotsTest-Group-228462224: created successfully Jul 13 20:35:45 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0e6ca358-f4f3-437f-b9bc-bc63053927a6 tempest-GroupSnapshotsTest-1740638669 None] Create group completed successfully. Jul 13 20:35:45 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 Jul 13 20:35:45 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:46 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd28bd0c-0c86-4794-ba5e-80f61f1bb715 tempest-VolumesExtendTest-1216259433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868" returned: 0 in 0.385s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd28bd0c-0c86-4794-ba5e-80f61f1bb715 tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:46 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 Jul 13 20:35:46 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:46 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd28bd0c-0c86-4794-ba5e-80f61f1bb715 tempest-VolumesExtendTest-1216259433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868" returned: 1 in 0.462s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd28bd0c-0c86-4794-ba5e-80f61f1bb715 tempest-VolumesExtendTest-1216259433 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd28bd0c-0c86-4794-ba5e-80f61f1bb715 tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 2G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd28bd0c-0c86-4794-ba5e-80f61f1bb715 tempest-VolumesExtendTest-1216259433 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 2G" returned: 0 in 0.110s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cd28bd0c-0c86-4794-ba5e-80f61f1bb715 tempest-VolumesExtendTest-1216259433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.019s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:46 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-cd28bd0c-0c86-4794-ba5e-80f61f1bb715 tempest-VolumesExtendTest-1216259433 None] Extend volume completed successfully. Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Flow 'volume_create_manager' (4343a704-673f-478d-b6b0-cd7a7090baa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0741042-898b-4907-bd3d-6719c2508a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0741042-898b-4907-bd3d-6719c2508a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1693910214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0dcc96e-d7a9-4254-a7a3-c58ccefe6030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277c14ac956342e5ba41941e37eaf4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:47Z,use_quota=True,user_id='233d474065d746a0b561531396356a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865b7261-b455-42da-891b-9d1837abd89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865b7261-b455-42da-891b-9d1837abd89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c8f499-e0bb-41b3-ab01-6017bfec96cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c8f499-e0bb-41b3-ab01-6017bfec96cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0dcc96e-d7a9-4254-a7a3-c58ccefe6030', 'volume_name': 'volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e08ba1-a484-4bf8-971f-4dc1a25f23c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e08ba1-a484-4bf8-971f-4dc1a25f23c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff8fa83-8d77-4709-83df-3dbd62d955f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:46 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Volume c0dcc96e-d7a9-4254-a7a3-c58ccefe6030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030', 'volume_size': 1} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1693910214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0dcc96e-d7a9-4254-a7a3-c58ccefe6030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277c14ac956342e5ba41941e37eaf4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:47Z,use_quota=True,user_id='233d474065d746a0b561531396356a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Creating volume c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:35:46 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:35:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:46 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 1073741824 Jul 13 20:35:46 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:47 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:35:47 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Flow 'volume_create_manager' (f8e07e7f-a8fe-4983-b97f-f96d2c15399e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea59237-d407-4a51-b1de-a4378a75e30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 1073741824" returned: 0 in 0.771s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea59237-d407-4a51-b1de-a4378a75e30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951182856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d24f1294-efff-4371-b03c-ba80ddfe2af9,host='devstack@QuobyteHD#QuobyteHD',id=3247ef3f-049b-4319-b2f6-4a1f19216b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92748ca3e6bc43c089ea60f8f0c1bb34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:47Z,use_quota=True,user_id='50c969f9be054515ae851ed4cdca2a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98e6eb9-4f05-400c-a114-d761a5f479ae),volume_type_id=e98e6eb9-4f05-400c-a114-d761a5f479ae)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db73b29-e6f9-4bea-92f8-f2dccc5be49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db73b29-e6f9-4bea-92f8-f2dccc5be49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67382f55-d220-4948-9ff1-12cb275d6632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67382f55-d220-4948-9ff1-12cb275d6632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3247ef3f-049b-4319-b2f6-4a1f19216b2b', 'volume_name': 'volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd3dbb27-b698-4204-a7a3-7d09f7318cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd3dbb27-b698-4204-a7a3-7d09f7318cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4b5553-507f-41e6-947f-cf8697f26eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:47 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Volume 3247ef3f-049b-4319-b2f6-4a1f19216b2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b', 'volume_size': 1} Jul 13 20:35:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:47 devstack sudo[94024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 Jul 13 20:35:47 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] Acquiring lock "cinder-da8c23d2-306d-4cb2-95ec-57e5d427f868-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] Lock "cinder-da8c23d2-306d-4cb2-95ec-57e5d427f868-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:48 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030" returned: 0 in 0.532s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.573s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d24f1294-efff-4371-b03c-ba80ddfe2af9,created_at=2026-07-13T18:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951182856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d24f1294-efff-4371-b03c-ba80ddfe2af9,host='devstack@QuobyteHD#QuobyteHD',id=3247ef3f-049b-4319-b2f6-4a1f19216b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92748ca3e6bc43c089ea60f8f0c1bb34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:47Z,use_quota=True,user_id='50c969f9be054515ae851ed4cdca2a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98e6eb9-4f05-400c-a114-d761a5f479ae),volume_type_id=e98e6eb9-4f05-400c-a114-d761a5f479ae)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Creating volume 3247ef3f-049b-4319-b2f6-4a1f19216b2b {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:35:48 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:48 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b 1073741824 Jul 13 20:35:48 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff8fa83-8d77-4709-83df-3dbd62d955f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559ea7f8-1553-4b60-88bb-2ac0bc9fe2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:48 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Volume volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 (c0dcc96e-d7a9-4254-a7a3-c58ccefe6030): created successfully Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559ea7f8-1553-4b60-88bb-2ac0bc9fe2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Flow 'volume_create_manager' (4343a704-673f-478d-b6b0-cd7a7090baa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] Acquiring lock "cinder-quobyte-da8c23d2-306d-4cb2-95ec-57e5d427f868" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:48 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-fa4badf5-5ee6-4573-8bd1-3a401189c2ac tempest-VolumesSnapshotTestJSON-233593282 None] Created volume successfully. Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] Lock "cinder-quobyte-da8c23d2-306d-4cb2-95ec-57e5d427f868" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0008f197-96a9-4fa7-9202-c0cf713c4ef4]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:48 devstack sudo[94044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 Jul 13 20:35:48 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=150,cinder:SELECT=146,cinder:INSERT=40,cinder:DELETE=10 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:35:48 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:48 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=130,cinder:UPDATE=134,cinder:DELETE=4,cinder:INSERT=36 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b 1073741824" returned: 0 in 0.672s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-29587236-ffb6-4e72-88dc-77f9300254f0 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:49 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868" returned: 0 in 0.507s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:49 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b Jul 13 20:35:49 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:49 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 Jul 13 20:35:49 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:49 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868" returned: 1 in 0.527s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:49 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868 Jul 13 20:35:49 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:49 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b" returned: 0 in 0.587s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-29587236-ffb6-4e72-88dc-77f9300254f0 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.681s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-29587236-ffb6-4e72-88dc-77f9300254f0 tempest-VolumesSnapshotTestJSON-233593282 None] Creating offline snapshot 847bd3f5-faa8-4f73-81f5-ee3ff5591e77 of volume c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4b5553-507f-41e6-947f-cf8697f26eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ead2d2-b1a7-4ec6-aedf-7933143665a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[623cbb48-7da3-4a67-9277-930d65b31f9e]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29587236-ffb6-4e72-88dc-77f9300254f0 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:49 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Volume volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b (3247ef3f-049b-4319-b2f6-4a1f19216b2b): created successfully Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ead2d2-b1a7-4ec6-aedf-7933143665a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Flow 'volume_create_manager' (f8e07e7f-a8fe-4983-b97f-f96d2c15399e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:49 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-723db473-ab97-4f39-b052-af81b1610c8e tempest-GroupSnapshotsTest-1740638669 None] Created volume successfully. Jul 13 20:35:49 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-da8c23d2-306d-4cb2-95ec-57e5d427f868" returned: 0 in 0.313s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:49 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 Jul 13 20:35:49 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] Lock "cinder-quobyte-da8c23d2-306d-4cb2-95ec-57e5d427f868" released by "delete_volume" :: held 1.445s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:50 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] Created reservations ['f34820db-4c50-4b4b-8043-b4fff8c22f00', '8eb5d935-bba1-4fc9-a4ed-347767d81bcb', '73e672ba-4d73-4841-b2a9-49ac48db92d1', '690bf75f-0ce2-46d5-bda9-58d762004da7'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:35:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:50 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:35:50 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:50 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29587236-ffb6-4e72-88dc-77f9300254f0 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030" returned: 0 in 0.516s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29587236-ffb6-4e72-88dc-77f9300254f0 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:50 devstack sudo[94073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77 1G Jul 13 20:35:50 devstack sudo[94073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:50 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] GroupSnapshot e98e2147-4857-4c70-9e52-5bc2005981f4: creating. Jul 13 20:35:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] Group snapshot e98e2147-4857-4c70-9e52-5bc2005981f4: creating. {{(pid=87269) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 13 20:35:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:50 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.334s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:50 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:35:50 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] Deleted volume successfully. Jul 13 20:35:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7e39a451-1397-46c8-b2dd-a37ee09703d6 tempest-VolumesExtendTest-1216259433 None] Lock "cinder-da8c23d2-306d-4cb2-95ec-57e5d427f868-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:50 devstack sudo[94073]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29587236-ffb6-4e72-88dc-77f9300254f0 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77 1G" returned: 0 in 0.636s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29587236-ffb6-4e72-88dc-77f9300254f0 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:50 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77 Jul 13 20:35:50 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:51 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:51 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:35:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Flow 'volume_create_manager' (41190614-5cb3-4a9c-919a-cf0908266674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ebce6a1-e44c-4d16-84c7-0f0f0af667fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29587236-ffb6-4e72-88dc-77f9300254f0 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77" returned: 0 in 0.383s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:51 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-29587236-ffb6-4e72-88dc-77f9300254f0 tempest-VolumesSnapshotTestJSON-233593282 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77 is being set with open permissions: ugo+rw Jul 13 20:35:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29587236-ffb6-4e72-88dc-77f9300254f0 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:51 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77 Jul 13 20:35:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ebce6a1-e44c-4d16-84c7-0f0f0af667fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-812388617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c871a78c-f393-484f-b3dc-a8ee45653072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc311a54b09a4bd08f2d2d9e70b4d476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:51Z,use_quota=True,user_id='0723147f0b664aadbebfa45a9e96d65b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:51 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ed2af0-77e7-4202-b4e7-8db2e32929ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ed2af0-77e7-4202-b4e7-8db2e32929ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7984f6d-cdba-4dd2-bb94-b5c979a204c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7984f6d-cdba-4dd2-bb94-b5c979a204c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c871a78c-f393-484f-b3dc-a8ee45653072', 'volume_name': 'volume-c871a78c-f393-484f-b3dc-a8ee45653072', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a574bc7c-2bf2-4e22-829a-9490a0b89437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a574bc7c-2bf2-4e22-829a-9490a0b89437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aafbbede-6663-424f-89ce-50e5882d4f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:51 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Volume c871a78c-f393-484f-b3dc-a8ee45653072: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c871a78c-f393-484f-b3dc-a8ee45653072', 'volume_size': 1} Jul 13 20:35:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:51 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29587236-ffb6-4e72-88dc-77f9300254f0 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77" returned: 0 in 0.268s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29587236-ffb6-4e72-88dc-77f9300254f0 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:51 devstack sudo[94088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.info Jul 13 20:35:51 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:51 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29587236-ffb6-4e72-88dc-77f9300254f0 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.info" returned: 0 in 0.250s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:51 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-29587236-ffb6-4e72-88dc-77f9300254f0 tempest-VolumesSnapshotTestJSON-233593282 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.info is being set with open permissions: ugo+rw Jul 13 20:35:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29587236-ffb6-4e72-88dc-77f9300254f0 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:51 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.info Jul 13 20:35:51 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:52 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29587236-ffb6-4e72-88dc-77f9300254f0 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.info" returned: 0 in 0.253s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-29587236-ffb6-4e72-88dc-77f9300254f0 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.438s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.726s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] Creating offline snapshot 1f19265b-e4a7-47cd-9bd5-7e9b06e4116e of volume 3247ef3f-049b-4319-b2f6-4a1f19216b2b {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:35:52 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-29587236-ffb6-4e72-88dc-77f9300254f0 tempest-VolumesSnapshotTestJSON-233593282 None] Create snapshot completed successfully Jul 13 20:35:52 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d94df42-265b-4bcb-85ca-0667de012242]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:52 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b Jul 13 20:35:52 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:52 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b" returned: 0 in 0.395s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:52 devstack sudo[94099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e 1G Jul 13 20:35:52 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:53 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e 1G" returned: 0 in 0.447s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:53 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e Jul 13 20:35:53 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:53 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e" returned: 0 in 0.331s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:53 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e is being set with open permissions: ugo+rw: NotImplementedError Jul 13 20:35:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:53 devstack sudo[94110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e Jul 13 20:35:53 devstack sudo[94110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:53 devstack sudo[94110]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e" returned: 0 in 0.306s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:53 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.info Jul 13 20:35:53 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:53 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:35:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Flow 'volume_create_manager' (3436db10-5815-4138-9235-1544600e7c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ad0c75-822e-4871-a19b-0ae1c2038518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ad0c75-822e-4871-a19b-0ae1c2038518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1409674195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8deecdce-d4c3-4269-bf50-f5439b45fae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277c14ac956342e5ba41941e37eaf4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=847bd3f5-faa8-4f73-81f5-ee3ff5591e77,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:54Z,use_quota=True,user_id='233d474065d746a0b561531396356a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5c99d8-5054-4b8e-a84a-fb639ab1c53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5c99d8-5054-4b8e-a84a-fb639ab1c53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4adc1a2-f3ef-4298-b02e-d3ad15abc850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4adc1a2-f3ef-4298-b02e-d3ad15abc850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8deecdce-d4c3-4269-bf50-f5439b45fae9', 'volume_name': 'volume-8deecdce-d4c3-4269-bf50-f5439b45fae9', 'volume_size': 2, 'snapshot_id': '847bd3f5-faa8-4f73-81f5-ee3ff5591e77'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520a663e-8d43-4c93-b055-e73bb9dca0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520a663e-8d43-4c93-b055-e73bb9dca0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da017df4-62e0-469c-84a9-621cabf6eea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:53 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Volume 8deecdce-d4c3-4269-bf50-f5439b45fae9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8deecdce-d4c3-4269-bf50-f5439b45fae9', 'volume_size': 2, 'snapshot_id': '847bd3f5-faa8-4f73-81f5-ee3ff5591e77'} Jul 13 20:35:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:54 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.info" returned: 0 in 0.275s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:54 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:54 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.info Jul 13 20:35:54 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:54 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.info" returned: 0 in 0.241s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.924s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-812388617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c871a78c-f393-484f-b3dc-a8ee45653072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc311a54b09a4bd08f2d2d9e70b4d476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:35:51Z,use_quota=True,user_id='0723147f0b664aadbebfa45a9e96d65b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Creating volume c871a78c-f393-484f-b3dc-a8ee45653072 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:35:54 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:54 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072 1073741824 Jul 13 20:35:54 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b8180d1c-c82d-4b44-b85a-c085dd58ea65 tempest-GroupSnapshotsTest-1740638669 None] group_snapshot e98e2147-4857-4c70-9e52-5bc2005981f4: created successfully Jul 13 20:35:54 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072 1073741824" returned: 0 in 0.491s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] group_snapshot e98e2147-4857-4c70-9e52-5bc2005981f4: deleting Jul 13 20:35:54 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072 Jul 13 20:35:54 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] group_snapshot e98e2147-4857-4c70-9e52-5bc2005981f4: deleting {{(pid=87269) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "cinder-quobyte-3247ef3f-049b-4319-b2f6-4a1f19216b2b" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-3247ef3f-049b-4319-b2f6-4a1f19216b2b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "cinder-quobyte-1f19265b-e4a7-47cd-9bd5-7e9b06e4116e" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-1f19265b-e4a7-47cd-9bd5-7e9b06e4116e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] Deleting offline snapshot 1f19265b-e4a7-47cd-9bd5-7e9b06e4116e of volume 3247ef3f-049b-4319-b2f6-4a1f19216b2b {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] snapshot_file for this snap is: volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[84955c6c-6fe9-45b2-8411-b583082f13a7]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:55 devstack sudo[94133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e Jul 13 20:35:55 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:55 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072" returned: 0 in 0.340s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.240s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-quobyte-847bd3f5-faa8-4f73-81f5-ee3ff5591e77-8deecdce-d4c3-4269-bf50-f5439b45fae9" by "_create_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aafbbede-6663-424f-89ce-50e5882d4f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c871a78c-f393-484f-b3dc-a8ee45653072', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53778ca-13c6-462f-8071-1d03a3f40aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-847bd3f5-faa8-4f73-81f5-ee3ff5591e77-8deecdce-d4c3-4269-bf50-f5439b45fae9" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Creating volume 8deecdce-d4c3-4269-bf50-f5439b45fae9 from snapshot 847bd3f5-faa8-4f73-81f5-ee3ff5591e77 {{(pid=87269) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-quobyte-8deecdce-d4c3-4269-bf50-f5439b45fae9" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:55 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Volume volume-c871a78c-f393-484f-b3dc-a8ee45653072 (c871a78c-f393-484f-b3dc-a8ee45653072): created successfully Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53778ca-13c6-462f-8071-1d03a3f40aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Flow 'volume_create_manager' (41190614-5cb3-4a9c-919a-cf0908266674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-8deecdce-d4c3-4269-bf50-f5439b45fae9" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] snapshot: 847bd3f5-faa8-4f73-81f5-ee3ff5591e77, volume: 8deecdce-d4c3-4269-bf50-f5439b45fae9, {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 20:35:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-92667b0c-bd26-46ac-a4e8-0ad31574b23f tempest-VolumesExtendTest-1216259433 None] Created volume successfully. Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[275a9164-0e51-44ae-8d49-78dea0973764]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:55 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e" returned: 0 in 0.465s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:35:55 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77 Jul 13 20:35:55 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb6cac4-aedf-40bc-9640-d7733a0dacaf]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:55 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b Jul 13 20:35:55 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-41fa866d-79ee-422a-a625-39529501ffc2 tempest-VolumesExtendTest-1216259433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:35:55 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77" returned: 0 in 0.510s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2123021c-906b-4590-bc24-81da988086ff]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:55 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b" returned: 0 in 0.505s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:55 devstack sudo[94147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 Jul 13 20:35:55 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:56 devstack sudo[94152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e Jul 13 20:35:56 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:56 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030" returned: 0 in 0.402s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:56 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Path /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8deecdce-d4c3-4269-bf50-f5439b45fae9 not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 20:35:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8deecdce-d4c3-4269-bf50-f5439b45fae9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:56 devstack sudo[94160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8deecdce-d4c3-4269-bf50-f5439b45fae9 Jul 13 20:35:56 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:56 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e" returned: 0 in 0.346s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:56 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e Jul 13 20:35:56 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:56 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b.1f19265b-e4a7-47cd-9bd5-7e9b06e4116e" returned: 0 in 0.282s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-1f19265b-e4a7-47cd-9bd5-7e9b06e4116e" released by "_delete_snapshot" :: held 1.720s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-3247ef3f-049b-4319-b2f6-4a1f19216b2b" released by "delete_snapshot" :: held 1.756s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:35:56 devstack cinder-volume[87269]: WARNING cinder.quota [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1730277544 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1730277544, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:35:56 devstack cinder-volume[87269]: WARNING cinder.quota [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1730277544 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1730277544, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:35:56 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] Created reservations ['117059eb-91a1-49ba-8ea8-a457fdfb8fa6', '8cd08ee3-dd46-4915-8e04-126400382ece', '6c5e3021-2cc9-4c73-af2e-468cc2295ec1', '75df88bf-ad87-4f80-8567-4af3857faf6c'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:35:57 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d13d61e0-7652-477a-bad0-6dfdb8f3320b tempest-GroupSnapshotsTest-1740638669 None] group_snapshot e98e2147-4857-4c70-9e52-5bc2005981f4: deleted successfully Jul 13 20:35:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-33d812ec-c9fb-45b4-a6a2-4f276c7488a7 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "cinder-quobyte-3247ef3f-049b-4319-b2f6-4a1f19216b2b" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:35:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-33d812ec-c9fb-45b4-a6a2-4f276c7488a7 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-3247ef3f-049b-4319-b2f6-4a1f19216b2b" acquired by "delete_volume" :: waited 0.056s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:35:58 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc1a77e-d4d1-4e42-b76a-8fe216b902da]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:35:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33d812ec-c9fb-45b4-a6a2-4f276c7488a7 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:58 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b Jul 13 20:35:58 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:59 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Jul 13 20:35:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33d812ec-c9fb-45b4-a6a2-4f276c7488a7 tempest-GroupSnapshotsTest-1740638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b" returned: 0 in 0.976s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:35:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33d812ec-c9fb-45b4-a6a2-4f276c7488a7 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:35:59 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b Jul 13 20:35:59 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:35:59 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33d812ec-c9fb-45b4-a6a2-4f276c7488a7 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3247ef3f-049b-4319-b2f6-4a1f19216b2b" returned: 0 in 0.762s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-33d812ec-c9fb-45b4-a6a2-4f276c7488a7 tempest-GroupSnapshotsTest-1740638669 None] Lock "cinder-quobyte-3247ef3f-049b-4319-b2f6-4a1f19216b2b" released by "delete_volume" :: held 1.927s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:00 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-33d812ec-c9fb-45b4-a6a2-4f276c7488a7 tempest-GroupSnapshotsTest-1740638669 None] Created reservations ['dc4bfb31-946c-4c95-a507-9f2e3c4aa0b8'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:36:00 devstack cinder-volume[87269]: WARNING cinder.quota [None req-33d812ec-c9fb-45b4-a6a2-4f276c7488a7 tempest-GroupSnapshotsTest-1740638669 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1730277544 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1730277544, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:36:00 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-33d812ec-c9fb-45b4-a6a2-4f276c7488a7 tempest-GroupSnapshotsTest-1740638669 None] Created reservations ['3d5ed4dd-7b5e-4dfa-9e85-cc1c40c7486c', 'c6e24d5b-1b51-4180-89bf-d8b78b061c7e', '322d3d03-ca6b-4642-8ded-f016710a6a71', 'bb3bc530-c6f5-4715-8d16-0d1aa3aaa49a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:36:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-33d812ec-c9fb-45b4-a6a2-4f276c7488a7 tempest-GroupSnapshotsTest-1740638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-33d812ec-c9fb-45b4-a6a2-4f276c7488a7 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-33d812ec-c9fb-45b4-a6a2-4f276c7488a7 tempest-GroupSnapshotsTest-1740638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-33d812ec-c9fb-45b4-a6a2-4f276c7488a7 tempest-GroupSnapshotsTest-1740638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-33d812ec-c9fb-45b4-a6a2-4f276c7488a7 tempest-GroupSnapshotsTest-1740638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33d812ec-c9fb-45b4-a6a2-4f276c7488a7 tempest-GroupSnapshotsTest-1740638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:00 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:36:00 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:01 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33d812ec-c9fb-45b4-a6a2-4f276c7488a7 tempest-GroupSnapshotsTest-1740638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.835s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-33d812ec-c9fb-45b4-a6a2-4f276c7488a7 tempest-GroupSnapshotsTest-1740638669 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:36:01 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-33d812ec-c9fb-45b4-a6a2-4f276c7488a7 tempest-GroupSnapshotsTest-1740638669 None] Delete group completed successfully. Jul 13 20:36:01 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8deecdce-d4c3-4269-bf50-f5439b45fae9" returned: 0 in 5.668s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:01 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50d3f48-0c78-4570-8f68-722a6ccf04ce]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:02 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 Jul 13 20:36:02 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:02 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030" returned: 0 in 0.562s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:02 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8deecdce-d4c3-4269-bf50-f5439b45fae9 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:36:02 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Converted 1024.00 MB image at 180.64 MB/s Jul 13 20:36:02 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8deecdce-d4c3-4269-bf50-f5439b45fae9 is being set with open permissions: ugo+rw Jul 13 20:36:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8deecdce-d4c3-4269-bf50-f5439b45fae9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:02 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8deecdce-d4c3-4269-bf50-f5439b45fae9 Jul 13 20:36:02 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:02 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8deecdce-d4c3-4269-bf50-f5439b45fae9" returned: 0 in 0.281s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-8deecdce-d4c3-4269-bf50-f5439b45fae9" released by "_copy_volume_from_snapshot" :: held 7.543s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-847bd3f5-faa8-4f73-81f5-ee3ff5591e77-8deecdce-d4c3-4269-bf50-f5439b45fae9" released by "_create_volume_from_snapshot" :: held 7.615s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.660s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-41fa866d-79ee-422a-a625-39529501ffc2 tempest-VolumesExtendTest-1216259433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.069s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-41fa866d-79ee-422a-a625-39529501ffc2 tempest-VolumesExtendTest-1216259433 None] Creating offline snapshot 7196046b-b1a4-4af7-beea-f93548478fa9 of volume c871a78c-f393-484f-b3dc-a8ee45653072 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:36:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da017df4-62e0-469c-84a9-621cabf6eea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8deecdce-d4c3-4269-bf50-f5439b45fae9', 'volume_size': 2, 'snapshot_id': '847bd3f5-faa8-4f73-81f5-ee3ff5591e77'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733d913a-d9c0-4c30-8a1b-733103f68ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:02 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc38b42-149b-4453-af84-e73e2c5cdd30]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-41fa866d-79ee-422a-a625-39529501ffc2 tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:02 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Volume volume-8deecdce-d4c3-4269-bf50-f5439b45fae9 (8deecdce-d4c3-4269-bf50-f5439b45fae9): created successfully Jul 13 20:36:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733d913a-d9c0-4c30-8a1b-733103f68ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Flow 'volume_create_manager' (3436db10-5815-4138-9235-1544600e7c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:36:03 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-572e3541-26f4-4c67-96cd-95b47c0e92a0 tempest-VolumesSnapshotTestJSON-233593282 None] Created volume successfully. Jul 13 20:36:03 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072 Jul 13 20:36:03 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:03 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-41fa866d-79ee-422a-a625-39529501ffc2 tempest-VolumesExtendTest-1216259433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072" returned: 0 in 0.482s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-41fa866d-79ee-422a-a625-39529501ffc2 tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:03 devstack sudo[94203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9 1G Jul 13 20:36:03 devstack sudo[94203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:03 devstack sudo[94203]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-41fa866d-79ee-422a-a625-39529501ffc2 tempest-VolumesExtendTest-1216259433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9 1G" returned: 0 in 0.421s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-41fa866d-79ee-422a-a625-39529501ffc2 tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c871a78c-f393-484f-b3dc-a8ee45653072 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:03 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c871a78c-f393-484f-b3dc-a8ee45653072 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9 Jul 13 20:36:03 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-8deecdce-d4c3-4269-bf50-f5439b45fae9-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-8deecdce-d4c3-4269-bf50-f5439b45fae9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:04 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-41fa866d-79ee-422a-a625-39529501ffc2 tempest-VolumesExtendTest-1216259433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c871a78c-f393-484f-b3dc-a8ee45653072 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9" returned: 0 in 0.374s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:04 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-41fa866d-79ee-422a-a625-39529501ffc2 tempest-VolumesExtendTest-1216259433 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9 is being set with open permissions: ugo+rw Jul 13 20:36:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-41fa866d-79ee-422a-a625-39529501ffc2 tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-quobyte-8deecdce-d4c3-4269-bf50-f5439b45fae9" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:04 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9 Jul 13 20:36:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-8deecdce-d4c3-4269-bf50-f5439b45fae9" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:04 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:04 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab5268e-16f2-4e2f-81ae-abff9aa529f2]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8deecdce-d4c3-4269-bf50-f5439b45fae9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:04 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8deecdce-d4c3-4269-bf50-f5439b45fae9 Jul 13 20:36:04 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:04 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-41fa866d-79ee-422a-a625-39529501ffc2 tempest-VolumesExtendTest-1216259433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9" returned: 0 in 0.326s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-41fa866d-79ee-422a-a625-39529501ffc2 tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:04 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.info Jul 13 20:36:04 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:04 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8deecdce-d4c3-4269-bf50-f5439b45fae9" returned: 0 in 0.443s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8deecdce-d4c3-4269-bf50-f5439b45fae9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:04 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8deecdce-d4c3-4269-bf50-f5439b45fae9 Jul 13 20:36:04 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:04 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-41fa866d-79ee-422a-a625-39529501ffc2 tempest-VolumesExtendTest-1216259433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.info" returned: 0 in 0.274s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:04 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-41fa866d-79ee-422a-a625-39529501ffc2 tempest-VolumesExtendTest-1216259433 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.info is being set with open permissions: ugo+rw Jul 13 20:36:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-41fa866d-79ee-422a-a625-39529501ffc2 tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:04 devstack sudo[94229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.info Jul 13 20:36:04 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:05 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8deecdce-d4c3-4269-bf50-f5439b45fae9" returned: 0 in 0.296s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-8deecdce-d4c3-4269-bf50-f5439b45fae9" released by "delete_volume" :: held 0.795s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:05 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-41fa866d-79ee-422a-a625-39529501ffc2 tempest-VolumesExtendTest-1216259433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.info" returned: 0 in 0.249s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-41fa866d-79ee-422a-a625-39529501ffc2 tempest-VolumesExtendTest-1216259433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.279s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] Created reservations ['5c715d40-41da-4e23-bd2c-e19edaaee90d', '77da71ae-d4ba-4630-b0a6-afcc3d9c4af3', 'f52fc31a-c201-4911-b669-db14e28ff274', '31c972d9-8715-4a3b-aa5e-54f83a45cb07'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:36:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-41fa866d-79ee-422a-a625-39529501ffc2 tempest-VolumesExtendTest-1216259433 None] Create snapshot completed successfully Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:05 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:36:05 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-847bd3f5-faa8-4f73-81f5-ee3ff5591e77-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-847bd3f5-faa8-4f73-81f5-ee3ff5591e77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-quobyte-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-quobyte-847bd3f5-faa8-4f73-81f5-ee3ff5591e77" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-847bd3f5-faa8-4f73-81f5-ee3ff5591e77" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] Deleting offline snapshot 847bd3f5-faa8-4f73-81f5-ee3ff5591e77 of volume c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:36:05 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] snapshot_file for this snap is: volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.307s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8770cc-cd62-48ba-9d63-f3c72befbf70]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] Deleted volume successfully. Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3da6b482-ce47-4bf8-b873-be93abda3464 tempest-VolumesExtendTest-1216259433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3da6b482-ce47-4bf8-b873-be93abda3464 tempest-VolumesExtendTest-1216259433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e88a3866-d97a-48c9-899a-885e772d5d9a tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-8deecdce-d4c3-4269-bf50-f5439b45fae9-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d15e8a-b509-43d3-a9f7-9a056a3dcbf8]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3da6b482-ce47-4bf8-b873-be93abda3464 tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:05 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77 Jul 13 20:36:05 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:05 devstack sudo[94237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072 Jul 13 20:36:05 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:05 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77" returned: 0 in 0.447s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bdaa0f-2ef0-4643-bba7-a87fae14a56b]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:06 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3da6b482-ce47-4bf8-b873-be93abda3464 tempest-VolumesExtendTest-1216259433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072" returned: 0 in 0.401s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3da6b482-ce47-4bf8-b873-be93abda3464 tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9 2G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:06 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 Jul 13 20:36:06 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3da6b482-ce47-4bf8-b873-be93abda3464 tempest-VolumesExtendTest-1216259433 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9 2G" returned: 0 in 0.159s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3da6b482-ce47-4bf8-b873-be93abda3464 tempest-VolumesExtendTest-1216259433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.608s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3da6b482-ce47-4bf8-b873-be93abda3464 tempest-VolumesExtendTest-1216259433 None] Extend volume completed successfully. Jul 13 20:36:06 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030" returned: 0 in 0.402s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:06 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77 Jul 13 20:36:06 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:06 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77" returned: 0 in 0.374s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:06 devstack sudo[94262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77 Jul 13 20:36:06 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] Acquiring lock "cinder-7196046b-b1a4-4af7-beea-f93548478fa9-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] Lock "cinder-7196046b-b1a4-4af7-beea-f93548478fa9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] Acquiring lock "cinder-quobyte-c871a78c-f393-484f-b3dc-a8ee45653072" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] Lock "cinder-quobyte-c871a78c-f393-484f-b3dc-a8ee45653072" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] Acquiring lock "cinder-quobyte-7196046b-b1a4-4af7-beea-f93548478fa9" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] Lock "cinder-quobyte-7196046b-b1a4-4af7-beea-f93548478fa9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] Deleting offline snapshot 7196046b-b1a4-4af7-beea-f93548478fa9 of volume c871a78c-f393-484f-b3dc-a8ee45653072 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] snapshot_file for this snap is: volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d89c4d5-74ea-4fe5-9867-dcd75a9e333f]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:07 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9 Jul 13 20:36:07 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:07 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030.847bd3f5-faa8-4f73-81f5-ee3ff5591e77" returned: 0 in 0.323s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-847bd3f5-faa8-4f73-81f5-ee3ff5591e77" released by "_delete_snapshot" :: held 1.673s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030" released by "delete_snapshot" :: held 1.705s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:07 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] Created reservations ['18a797f0-7df0-4505-a6b8-7f1462a7c551', '46175ba6-f757-40a1-93f1-a75ec4a6b1c2', 'e58338da-2217-47a7-adf3-df8906b24fca', 'cb864b0f-d394-4803-a253-540f8ab40bbe'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:36:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] Delete snapshot completed successfully. Jul 13 20:36:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ddcd7b6c-a787-4cad-a306-3d4ea612e270 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-847bd3f5-faa8-4f73-81f5-ee3ff5591e77-delete_snapshot" released by "delete_snapshot" :: held 1.907s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:07 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9" returned: 0 in 0.403s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c871a78c-f393-484f-b3dc-a8ee45653072(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:36:07 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eabe79-37ef-43ef-bf2b-e9160c34e727]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:07 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072 Jul 13 20:36:07 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-quobyte-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:07 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1f96ec-2a64-4f85-b073-bc980e8d23f4]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:07 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072" returned: 0 in 0.450s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:07 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9 Jul 13 20:36:07 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:07 devstack sudo[94276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 Jul 13 20:36:07 devstack sudo[94276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:08 devstack sudo[94276]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030" returned: 0 in 0.407s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:08 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9" returned: 0 in 0.416s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:08 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030 Jul 13 20:36:08 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:08 devstack sudo[94288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9 Jul 13 20:36:08 devstack sudo[94288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:08 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030" returned: 0 in 0.304s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:08 devstack sudo[94288]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072.7196046b-b1a4-4af7-beea-f93548478fa9" returned: 0 in 0.294s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030" released by "delete_volume" :: held 0.783s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] Lock "cinder-quobyte-7196046b-b1a4-4af7-beea-f93548478fa9" released by "_delete_snapshot" :: held 1.687s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] Lock "cinder-quobyte-c871a78c-f393-484f-b3dc-a8ee45653072" released by "delete_snapshot" :: held 1.713s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:08 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] Created reservations ['e8b993b0-e86a-4c45-bd49-a0d92fa863ce', '5cc1fca9-4236-4dec-9956-5937f3c612c6', '71b50d68-7b10-42cb-aa1e-71f842082f1c', '9264d5fc-6cff-41f3-acbd-469db73251f3'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:36:08 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] Created reservations ['168818a0-84d5-4786-a362-e3d964df1343', 'a9af6e9b-5e6e-4414-82c4-c0ee50c5849b', 'cd595220-d4fb-4a55-a6ec-7a59d748c091', '5aa73151-7d3a-42fa-8cc7-283506517670'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:36:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:08 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:36:08 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] Delete snapshot completed successfully. Jul 13 20:36:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c95f7135-3803-469e-83e6-9591e36b084c tempest-VolumesExtendTest-1216259433 None] Lock "cinder-7196046b-b1a4-4af7-beea-f93548478fa9-delete_snapshot" released by "delete_snapshot" :: held 1.949s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:09 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.322s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:36:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] Deleted volume successfully. Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0556dc74-ec62-470a-ac39-c3f4c5ce63e7 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-c0dcc96e-d7a9-4254-a7a3-c58ccefe6030-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] Acquiring lock "cinder-c871a78c-f393-484f-b3dc-a8ee45653072-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] Lock "cinder-c871a78c-f393-484f-b3dc-a8ee45653072-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] Acquiring lock "cinder-quobyte-c871a78c-f393-484f-b3dc-a8ee45653072" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] Lock "cinder-quobyte-c871a78c-f393-484f-b3dc-a8ee45653072" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fce3c4-3b28-440f-a5e6-f8f41265edb0]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:09 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072 Jul 13 20:36:09 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Flow 'volume_create_manager' (41935c37-310f-4920-84b0-c8e72aacb472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e6ff89-cd78-4f71-a460-acec6afbea52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e6ff89-cd78-4f71-a460-acec6afbea52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-499887737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988df215-6b39-43f5-8364-570f7017df31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277c14ac956342e5ba41941e37eaf4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:36:09Z,use_quota=True,user_id='233d474065d746a0b561531396356a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0432318e-85e0-48c2-aff1-5d386de9d42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0432318e-85e0-48c2-aff1-5d386de9d42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27206838-c74c-4f86-8aa2-658b77f4be3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27206838-c74c-4f86-8aa2-658b77f4be3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '988df215-6b39-43f5-8364-570f7017df31', 'volume_name': 'volume-988df215-6b39-43f5-8364-570f7017df31', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50367849-fdfd-4200-ae4c-a774350752b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50367849-fdfd-4200-ae4c-a774350752b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf5fcd18-d2fa-4bcb-93e1-f9d74ae91378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:09 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Volume 988df215-6b39-43f5-8364-570f7017df31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-988df215-6b39-43f5-8364-570f7017df31', 'volume_size': 1} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-499887737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988df215-6b39-43f5-8364-570f7017df31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277c14ac956342e5ba41941e37eaf4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:36:09Z,use_quota=True,user_id='233d474065d746a0b561531396356a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Creating volume 988df215-6b39-43f5-8364-570f7017df31 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:36:09 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:09 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 1073741824 Jul 13 20:36:09 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:09 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072" returned: 0 in 0.456s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:09 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072 Jul 13 20:36:09 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:10 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c871a78c-f393-484f-b3dc-a8ee45653072" returned: 0 in 0.302s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] Lock "cinder-quobyte-c871a78c-f393-484f-b3dc-a8ee45653072" released by "delete_volume" :: held 0.836s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] Created reservations ['1e8c8c3a-59cf-49e0-b7a7-6f08be9fad0b', '3206c385-9ae0-4965-9ab2-44890d6cbf9f', 'cf78fb15-267d-4bff-a6ef-1e4728547b39', '706185d5-da1b-49e7-b5e3-b8dcba8e78be'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:36:10 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 1073741824" returned: 0 in 0.569s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:10 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 Jul 13 20:36:10 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:10 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:36:10 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:10 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31" returned: 0 in 0.313s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf5fcd18-d2fa-4bcb-93e1-f9d74ae91378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-988df215-6b39-43f5-8364-570f7017df31', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed3617b-a3f3-4a0c-ab89-99899b1f8e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:10 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Volume volume-988df215-6b39-43f5-8364-570f7017df31 (988df215-6b39-43f5-8364-570f7017df31): created successfully Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed3617b-a3f3-4a0c-ab89-99899b1f8e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Flow 'volume_create_manager' (41935c37-310f-4920-84b0-c8e72aacb472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:36:10 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2844be89-6445-4bbb-997f-688ea0f7bdf1 tempest-VolumesSnapshotTestJSON-233593282 None] Created volume successfully. Jul 13 20:36:10 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.510s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:36:10 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] Deleted volume successfully. Jul 13 20:36:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ebf1c196-f296-4dd5-a6ad-b1d4b0a0521d tempest-VolumesExtendTest-1216259433 None] Lock "cinder-c871a78c-f393-484f-b3dc-a8ee45653072-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b086fa7e-bffe-4a69-a2f0-063fe82dea67 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b086fa7e-bffe-4a69-a2f0-063fe82dea67 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b086fa7e-bffe-4a69-a2f0-063fe82dea67 tempest-VolumesSnapshotTestJSON-233593282 None] Creating offline snapshot b3995110-9459-4924-bd43-64fbbd6b1149 of volume 988df215-6b39-43f5-8364-570f7017df31 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:36:11 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b41a84e-9c76-4696-b97b-13a0ce10a7e6]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b086fa7e-bffe-4a69-a2f0-063fe82dea67 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:12 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 Jul 13 20:36:12 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:12 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b086fa7e-bffe-4a69-a2f0-063fe82dea67 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31" returned: 0 in 0.458s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b086fa7e-bffe-4a69-a2f0-063fe82dea67 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:12 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149 1G Jul 13 20:36:12 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:12 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b086fa7e-bffe-4a69-a2f0-063fe82dea67 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149 1G" returned: 0 in 0.485s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b086fa7e-bffe-4a69-a2f0-063fe82dea67 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-988df215-6b39-43f5-8364-570f7017df31 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:12 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-988df215-6b39-43f5-8364-570f7017df31 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149 Jul 13 20:36:12 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:13 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b086fa7e-bffe-4a69-a2f0-063fe82dea67 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-988df215-6b39-43f5-8364-570f7017df31 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149" returned: 0 in 0.384s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:13 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-b086fa7e-bffe-4a69-a2f0-063fe82dea67 tempest-VolumesSnapshotTestJSON-233593282 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149 is being set with open permissions: ugo+rw Jul 13 20:36:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b086fa7e-bffe-4a69-a2f0-063fe82dea67 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:13 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149 Jul 13 20:36:13 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:13 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b086fa7e-bffe-4a69-a2f0-063fe82dea67 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149" returned: 0 in 0.334s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b086fa7e-bffe-4a69-a2f0-063fe82dea67 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:13 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.info Jul 13 20:36:13 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:13 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-22e85921-cd01-4e56-962c-16164ea46d7c tempest-GroupsV314Test-1379685677 None] Group tempest-GroupsV314Test-Group-2129699247: creating Jul 13 20:36:13 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-22e85921-cd01-4e56-962c-16164ea46d7c tempest-GroupsV314Test-1379685677 None] Group tempest-GroupsV314Test-Group-2129699247: created successfully Jul 13 20:36:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-22e85921-cd01-4e56-962c-16164ea46d7c tempest-GroupsV314Test-1379685677 None] Create group completed successfully. Jul 13 20:36:14 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b086fa7e-bffe-4a69-a2f0-063fe82dea67 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.info" returned: 0 in 0.519s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:14 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-b086fa7e-bffe-4a69-a2f0-063fe82dea67 tempest-VolumesSnapshotTestJSON-233593282 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.info is being set with open permissions: ugo+rw Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b086fa7e-bffe-4a69-a2f0-063fe82dea67 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:14 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.info Jul 13 20:36:14 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Flow 'volume_create_manager' (5df9b6c3-9d3f-4652-9e5a-80b033812a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef612ba3-8685-40f9-ac88-88e52e1f2eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef612ba3-8685-40f9-ac88-88e52e1f2eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1144252730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23567bd2-6a00-42af-b419-79295d5625aa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c79e3744b2b2434e87ed6111c427241d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:36:14Z,use_quota=True,user_id='7ebb2e11953e4765b995ebceb75fabf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4103937d-50a5-441d-a3d4-2fa6383cf32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4103937d-50a5-441d-a3d4-2fa6383cf32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3201f510-046b-4049-b637-9414509821d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3201f510-046b-4049-b637-9414509821d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23567bd2-6a00-42af-b419-79295d5625aa', 'volume_name': 'volume-23567bd2-6a00-42af-b419-79295d5625aa', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d811d2-55fd-45b4-981d-ac484cbdce49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d811d2-55fd-45b4-981d-ac484cbdce49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb464703-6a55-480f-a9a1-7f1bb7310313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:14 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Volume 23567bd2-6a00-42af-b419-79295d5625aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23567bd2-6a00-42af-b419-79295d5625aa', 'volume_size': 1} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:14 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b086fa7e-bffe-4a69-a2f0-063fe82dea67 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.info" returned: 0 in 0.313s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b086fa7e-bffe-4a69-a2f0-063fe82dea67 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.656s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.071s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1144252730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23567bd2-6a00-42af-b419-79295d5625aa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c79e3744b2b2434e87ed6111c427241d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:36:14Z,use_quota=True,user_id='7ebb2e11953e4765b995ebceb75fabf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Creating volume 23567bd2-6a00-42af-b419-79295d5625aa {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:36:14 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:36:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-23567bd2-6a00-42af-b419-79295d5625aa 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:14 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-23567bd2-6a00-42af-b419-79295d5625aa 1073741824 Jul 13 20:36:14 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b086fa7e-bffe-4a69-a2f0-063fe82dea67 tempest-VolumesSnapshotTestJSON-233593282 None] Create snapshot completed successfully Jul 13 20:36:15 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-23567bd2-6a00-42af-b419-79295d5625aa 1073741824" returned: 0 in 0.500s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-23567bd2-6a00-42af-b419-79295d5625aa {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:15 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-23567bd2-6a00-42af-b419-79295d5625aa Jul 13 20:36:15 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:15 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-23567bd2-6a00-42af-b419-79295d5625aa" returned: 0 in 0.484s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb464703-6a55-480f-a9a1-7f1bb7310313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23567bd2-6a00-42af-b419-79295d5625aa', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba259e7-172e-471e-987e-4d1bee4e422c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Flow 'volume_create_manager' (b2f8c73a-40ff-4ea6-acbf-043c7e1c6d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95fa5bb-7dec-433d-bf14-d7200c844a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95fa5bb-7dec-433d-bf14-d7200c844a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-865438315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60f4c443-baaf-41fd-9488-3d6b00d9a207,host='devstack@QuobyteHD#QuobyteHD',id=e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d5165725a24273bbfe7ec898ffc9d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:36:16Z,use_quota=True,user_id='fc31b2472aad491a898a13b9afa743fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c4c3eac-e90a-4586-83be-47d8dc5a0254),volume_type_id=1c4c3eac-e90a-4586-83be-47d8dc5a0254)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56999f4d-6893-49c6-aa4d-a0a004255791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56999f4d-6893-49c6-aa4d-a0a004255791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2dbb58-83e6-4b47-bec9-6f1df4c1080f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2dbb58-83e6-4b47-bec9-6f1df4c1080f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d', 'volume_name': 'volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af255028-a8c0-4764-8a31-417a9e3bfc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af255028-a8c0-4764-8a31-417a9e3bfc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84874aab-f6b5-424d-a4a2-d18b4ec1aa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:15 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Volume e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d', 'volume_size': 1} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=60f4c443-baaf-41fd-9488-3d6b00d9a207,created_at=2026-07-13T18:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-865438315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60f4c443-baaf-41fd-9488-3d6b00d9a207,host='devstack@QuobyteHD#QuobyteHD',id=e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d5165725a24273bbfe7ec898ffc9d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:36:16Z,use_quota=True,user_id='fc31b2472aad491a898a13b9afa743fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c4c3eac-e90a-4586-83be-47d8dc5a0254),volume_type_id=1c4c3eac-e90a-4586-83be-47d8dc5a0254)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Creating volume e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:36:15 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:15 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Volume volume-23567bd2-6a00-42af-b419-79295d5625aa (23567bd2-6a00-42af-b419-79295d5625aa): created successfully Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba259e7-172e-471e-987e-4d1bee4e422c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Flow 'volume_create_manager' (5df9b6c3-9d3f-4652-9e5a-80b033812a21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:36:15 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d 1073741824 Jul 13 20:36:15 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e4a7e503-7c4e-46a3-a866-29a143347511 tempest-VolumesGetTest-1999897006 None] Created volume successfully. Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Flow 'volume_create_manager' (6b24fbcc-a2e2-4a46-9eb5-81266a6bb62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23affb4c-5aed-497e-9a21-380e1987338c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23affb4c-5aed-497e-9a21-380e1987338c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2091724389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608fb5eb-97f4-4eb3-a01a-8d0dd270960e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277c14ac956342e5ba41941e37eaf4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b3995110-9459-4924-bd43-64fbbd6b1149,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:36:16Z,use_quota=True,user_id='233d474065d746a0b561531396356a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b4f001-e715-42f2-8965-60e0dc20edd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b4f001-e715-42f2-8965-60e0dc20edd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253359ba-13a3-40b4-85a1-904c8273ec4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253359ba-13a3-40b4-85a1-904c8273ec4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '608fb5eb-97f4-4eb3-a01a-8d0dd270960e', 'volume_name': 'volume-608fb5eb-97f4-4eb3-a01a-8d0dd270960e', 'volume_size': 1, 'snapshot_id': 'b3995110-9459-4924-bd43-64fbbd6b1149'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e84ffd6-56a8-46dd-8558-cca2bc078a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e84ffd6-56a8-46dd-8558-cca2bc078a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b182db0-4dfb-4ef0-b91b-f78dad0e0d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:16 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Volume 608fb5eb-97f4-4eb3-a01a-8d0dd270960e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-608fb5eb-97f4-4eb3-a01a-8d0dd270960e', 'volume_size': 1, 'snapshot_id': 'b3995110-9459-4924-bd43-64fbbd6b1149'} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:16 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d 1073741824" returned: 0 in 0.552s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:16 devstack sudo[94386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d Jul 13 20:36:16 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:16 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d" returned: 0 in 0.265s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.431s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-quobyte-b3995110-9459-4924-bd43-64fbbd6b1149-608fb5eb-97f4-4eb3-a01a-8d0dd270960e" by "_create_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84874aab-f6b5-424d-a4a2-d18b4ec1aa92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6995cbee-3d57-44ad-8f01-1e42d65734c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-b3995110-9459-4924-bd43-64fbbd6b1149-608fb5eb-97f4-4eb3-a01a-8d0dd270960e" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Creating volume 608fb5eb-97f4-4eb3-a01a-8d0dd270960e from snapshot b3995110-9459-4924-bd43-64fbbd6b1149 {{(pid=87269) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-quobyte-608fb5eb-97f4-4eb3-a01a-8d0dd270960e" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:16 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Volume volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d (e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d): created successfully Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6995cbee-3d57-44ad-8f01-1e42d65734c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Flow 'volume_create_manager' (b2f8c73a-40ff-4ea6-acbf-043c7e1c6d42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-608fb5eb-97f4-4eb3-a01a-8d0dd270960e" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] snapshot: b3995110-9459-4924-bd43-64fbbd6b1149, volume: 608fb5eb-97f4-4eb3-a01a-8d0dd270960e, {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-dff27269-50cf-4b85-9a4c-5190069ae59c tempest-GroupsV314Test-1379685677 None] Created volume successfully. Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6e13dc-55fb-4de4-8f97-323a13f328d4]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:16 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149 Jul 13 20:36:16 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:17 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149" returned: 0 in 0.519s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-988df215-6b39-43f5-8364-570f7017df31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:36:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 20:36:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 20:36:17 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4dac25-2004-4bd9-90fd-03392baecbb2]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:17 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 Jul 13 20:36:17 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:17 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31" returned: 0 in 0.579s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:17 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Path /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-608fb5eb-97f4-4eb3-a01a-8d0dd270960e not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 20:36:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-608fb5eb-97f4-4eb3-a01a-8d0dd270960e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:17 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:36:17 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-608fb5eb-97f4-4eb3-a01a-8d0dd270960e Jul 13 20:36:17 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Flow 'volume_create_manager' (42f62563-9a2c-4174-bf8f-61dd05182b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aafce71-c3c4-444b-935c-a02e4f43c483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aafce71-c3c4-444b-935c-a02e4f43c483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:36:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1333305707',display_name='tempest-VolumesGetTest-Volume-989989516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1935be15-9aa0-4e30-a722-2bb94420365b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c79e3744b2b2434e87ed6111c427241d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:36:18Z,use_quota=True,user_id='7ebb2e11953e4765b995ebceb75fabf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea4ee25e-d683-4604-9ef5-381d30046201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea4ee25e-d683-4604-9ef5-381d30046201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed1d36e-b77d-4706-bd09-1045db78a70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed1d36e-b77d-4706-bd09-1045db78a70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1935be15-9aa0-4e30-a722-2bb94420365b', 'volume_name': 'volume-1935be15-9aa0-4e30-a722-2bb94420365b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8f872e-b64a-4129-a8b4-7553408b6101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8f872e-b64a-4129-a8b4-7553408b6101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac9d0984-f48a-490d-8259-b47eab360bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:18 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Volume 1935be15-9aa0-4e30-a722-2bb94420365b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1935be15-9aa0-4e30-a722-2bb94420365b', 'volume_size': 1} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] Acquiring lock "cinder-8636655f-dad0-4451-bdcb-51d873aa4bca-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] Lock "cinder-8636655f-dad0-4451-bdcb-51d873aa4bca-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] Acquiring lock "cinder-quobyte-8636655f-dad0-4451-bdcb-51d873aa4bca" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] Lock "cinder-quobyte-8636655f-dad0-4451-bdcb-51d873aa4bca" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caeaa40-ef62-4420-9b81-85d8c32a6e82]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8636655f-dad0-4451-bdcb-51d873aa4bca {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:18 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8636655f-dad0-4451-bdcb-51d873aa4bca Jul 13 20:36:18 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:18 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8636655f-dad0-4451-bdcb-51d873aa4bca" returned: 0 in 0.439s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8636655f-dad0-4451-bdcb-51d873aa4bca {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:18 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8636655f-dad0-4451-bdcb-51d873aa4bca Jul 13 20:36:18 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:18 devstack sudo[94422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:36:18 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:19 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8636655f-dad0-4451-bdcb-51d873aa4bca" returned: 0 in 0.749s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] Lock "cinder-quobyte-8636655f-dad0-4451-bdcb-51d873aa4bca" released by "delete_volume" :: held 1.253s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:19 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.717s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:36:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:36:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:36:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:36:19 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] Created reservations ['12f2bd36-1685-4505-9923-67fbb2df5b30', '268a180f-3d97-41b7-9790-0a5f36667f79', '2c992b94-6352-4201-9890-d48a7b871fb5', '1d11bd0f-542f-4df4-9ca4-45be8b590ae4'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:36:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:19 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:36:19 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:20 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.470s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:20 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:36:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] Deleted volume successfully. Jul 13 20:36:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0f9135f2-0486-4464-bebc-84442b26d368 tempest-AttachVolumeShelveTestJSON-1079834049 None] Lock "cinder-8636655f-dad0-4451-bdcb-51d873aa4bca-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:22 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-608fb5eb-97f4-4eb3-a01a-8d0dd270960e" returned: 0 in 4.953s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:22 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[010d0821-d2d9-48a9-b4e8-f4fcc45047c8]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:23 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 Jul 13 20:36:23 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:23 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31" returned: 0 in 0.542s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:23 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31, size 1024.00 MB, duration 4.95 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-608fb5eb-97f4-4eb3-a01a-8d0dd270960e {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:36:23 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Converted 1024.00 MB image at 206.70 MB/s Jul 13 20:36:23 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-608fb5eb-97f4-4eb3-a01a-8d0dd270960e is being set with open permissions: ugo+rw Jul 13 20:36:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-608fb5eb-97f4-4eb3-a01a-8d0dd270960e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:23 devstack sudo[94437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-608fb5eb-97f4-4eb3-a01a-8d0dd270960e Jul 13 20:36:23 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:23 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-608fb5eb-97f4-4eb3-a01a-8d0dd270960e" returned: 0 in 0.271s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-608fb5eb-97f4-4eb3-a01a-8d0dd270960e" released by "_copy_volume_from_snapshot" :: held 6.995s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-b3995110-9459-4924-bd43-64fbbd6b1149-608fb5eb-97f4-4eb3-a01a-8d0dd270960e" released by "_create_volume_from_snapshot" :: held 7.043s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.088s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.903s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:23 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Cloning volume e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d to volume a886c32c-e8c4-4c2c-9401-235eef2c0f27 Jul 13 20:36:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b182db0-4dfb-4ef0-b91b-f78dad0e0d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-608fb5eb-97f4-4eb3-a01a-8d0dd270960e', 'volume_size': 1, 'snapshot_id': 'b3995110-9459-4924-bd43-64fbbd6b1149'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e707a29c-100c-445e-a0f8-e6d7db7b031b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Creating offline snapshot c6480f0d-5af8-424c-91bb-8942effd4c0c of volume e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:36:23 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Volume volume-608fb5eb-97f4-4eb3-a01a-8d0dd270960e (608fb5eb-97f4-4eb3-a01a-8d0dd270960e): created successfully Jul 13 20:36:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e707a29c-100c-445e-a0f8-e6d7db7b031b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Flow 'volume_create_manager' (6b24fbcc-a2e2-4a46-9eb5-81266a6bb62c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:36:23 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4faaf9e-eeb7-46e2-9219-7d02906ee954]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:23 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-bc145f49-74ce-465f-9d00-7ee6b12be32f tempest-VolumesSnapshotTestJSON-233593282 None] Created volume successfully. Jul 13 20:36:23 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d Jul 13 20:36:23 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:24 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d" returned: 0 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:24 devstack sudo[94445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c 1G Jul 13 20:36:24 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:24 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c 1G" returned: 0 in 0.471s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:24 devstack sudo[94451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c Jul 13 20:36:24 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-608fb5eb-97f4-4eb3-a01a-8d0dd270960e-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:25 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c" returned: 0 in 0.324s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:25 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c is being set with open permissions: ugo+rw: NotImplementedError Jul 13 20:36:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-608fb5eb-97f4-4eb3-a01a-8d0dd270960e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:25 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c Jul 13 20:36:25 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-quobyte-608fb5eb-97f4-4eb3-a01a-8d0dd270960e" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-608fb5eb-97f4-4eb3-a01a-8d0dd270960e" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:25 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce5e4dd-fd3b-4bf8-977d-ffb83ae584cc]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-608fb5eb-97f4-4eb3-a01a-8d0dd270960e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:25 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-608fb5eb-97f4-4eb3-a01a-8d0dd270960e Jul 13 20:36:25 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:25 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c" returned: 0 in 0.278s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:25 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.info Jul 13 20:36:25 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:25 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-608fb5eb-97f4-4eb3-a01a-8d0dd270960e" returned: 0 in 0.451s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-608fb5eb-97f4-4eb3-a01a-8d0dd270960e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:25 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.info" returned: 0 in 0.293s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:25 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 13 20:36:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:25 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-608fb5eb-97f4-4eb3-a01a-8d0dd270960e Jul 13 20:36:25 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:25 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.info Jul 13 20:36:25 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:25 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-608fb5eb-97f4-4eb3-a01a-8d0dd270960e" returned: 0 in 0.292s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-608fb5eb-97f4-4eb3-a01a-8d0dd270960e" released by "delete_volume" :: held 0.826s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:25 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.info" returned: 0 in 0.299s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Acquiring lock "cinder-quobyte-a886c32c-e8c4-4c2c-9401-235eef2c0f27" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Lock "cinder-quobyte-a886c32c-e8c4-4c2c-9401-235eef2c0f27" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] snapshot: c6480f0d-5af8-424c-91bb-8942effd4c0c, volume: a886c32c-e8c4-4c2c-9401-235eef2c0f27, {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fdaf12-b2b8-4afa-80af-f883ab4c5150]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] Created reservations ['0e119835-29bc-43de-8479-dde3e5fa5d84', '4d64c021-6cec-4cd8-88ab-10184c3e9a90', '993bee03-0e67-4812-86bb-0745144650f0', '5cf9cbbf-579b-484c-906f-e8da9332c800'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:26 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c Jul 13 20:36:26 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:26 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:36:26 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-b3995110-9459-4924-bd43-64fbbd6b1149-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-b3995110-9459-4924-bd43-64fbbd6b1149-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-quobyte-988df215-6b39-43f5-8364-570f7017df31" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-988df215-6b39-43f5-8364-570f7017df31" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-quobyte-b3995110-9459-4924-bd43-64fbbd6b1149" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-b3995110-9459-4924-bd43-64fbbd6b1149" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] Deleting offline snapshot b3995110-9459-4924-bd43-64fbbd6b1149 of volume 988df215-6b39-43f5-8364-570f7017df31 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] snapshot_file for this snap is: volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fed6ce-0832-455c-a2a2-23b1205a6bb4]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:26 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.367s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:36:26 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] Deleted volume successfully. Jul 13 20:36:26 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149 Jul 13 20:36:26 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d6bd1edf-dcf7-4632-a6d9-615472ca4b4d tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-608fb5eb-97f4-4eb3-a01a-8d0dd270960e-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:26 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c" returned: 0 in 0.584s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ace82f2-42fc-4087-b23c-5b25165306f1]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:26 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d Jul 13 20:36:26 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:26 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149" returned: 0 in 0.473s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-988df215-6b39-43f5-8364-570f7017df31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95279d8-4b10-4fdb-a9a2-d60fd12afc03]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:27 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 Jul 13 20:36:27 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:27 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d" returned: 0 in 0.407s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:27 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Path /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a886c32c-e8c4-4c2c-9401-235eef2c0f27 not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 20:36:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a886c32c-e8c4-4c2c-9401-235eef2c0f27 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:27 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a886c32c-e8c4-4c2c-9401-235eef2c0f27 Jul 13 20:36:27 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:27 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31" returned: 0 in 0.400s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:27 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149 Jul 13 20:36:27 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:27 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149" returned: 0 in 0.558s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:27 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149 Jul 13 20:36:27 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:28 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31.b3995110-9459-4924-bd43-64fbbd6b1149" returned: 0 in 0.711s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-b3995110-9459-4924-bd43-64fbbd6b1149" released by "_delete_snapshot" :: held 2.377s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-988df215-6b39-43f5-8364-570f7017df31" released by "delete_snapshot" :: held 2.426s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:29 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] Created reservations ['c3ca3858-51d0-4f13-9db3-f0bdfc7727a0', '9f983c7b-9225-40ba-8bbb-3db6a1f4fb95', '25cad42f-4164-4e22-9da0-53d6a3b14f8a', '101318b9-fc7f-4d66-9a89-b5d2846722d6'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:36:29 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] Delete snapshot completed successfully. Jul 13 20:36:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-83e2861f-e0c2-4dde-b4ff-211580114de7 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-b3995110-9459-4924-bd43-64fbbd6b1149-delete_snapshot" released by "delete_snapshot" :: held 2.841s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-988df215-6b39-43f5-8364-570f7017df31-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-988df215-6b39-43f5-8364-570f7017df31-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-quobyte-988df215-6b39-43f5-8364-570f7017df31" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-988df215-6b39-43f5-8364-570f7017df31" acquired by "delete_volume" :: waited 0.040s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:30 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b28822-148c-436a-947f-1bfc25044dff]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:30 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 Jul 13 20:36:30 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:31 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31" returned: 0 in 1.050s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:31 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31 Jul 13 20:36:31 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:31 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-988df215-6b39-43f5-8364-570f7017df31" returned: 0 in 0.547s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-988df215-6b39-43f5-8364-570f7017df31" released by "delete_volume" :: held 1.756s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:32 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] Created reservations ['6e5c80ae-0da8-4fc1-9ed1-b1c0af222718', '424f029b-6866-4ea9-b3e0-fd271cc67aac', 'f5b24d09-491d-4436-b295-5d7637a942ff', '92a56de5-7c53-47a9-95b6-52925d0dcf4f'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:36:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:32 devstack sudo[94531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:36:32 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:32 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a886c32c-e8c4-4c2c-9401-235eef2c0f27" returned: 0 in 5.636s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:32 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34d5525-0f31-42c8-be70-fdc84987bbc2]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:32 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.452s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:32 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:36:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] Deleted volume successfully. Jul 13 20:36:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-0376604d-48c1-4dde-a219-1c82166f30e0-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e3018303-084b-4414-aaa0-187ed36b3d98 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-988df215-6b39-43f5-8364-570f7017df31-delete_volume" released by "delete_volume" :: held 2.804s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-0376604d-48c1-4dde-a219-1c82166f30e0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "cinder-quobyte-0376604d-48c1-4dde-a219-1c82166f30e0" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-0376604d-48c1-4dde-a219-1c82166f30e0" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:32 devstack sudo[94534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d Jul 13 20:36:32 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:32 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb01fedd-a582-488e-a418-5c0ec3cdfdcc]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:33 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0 Jul 13 20:36:33 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:33 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0" returned: 0 in 0.413s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:33 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d" returned: 0 in 0.644s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a886c32c-e8c4-4c2c-9401-235eef2c0f27 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:36:33 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Converted 1024.00 MB image at 181.59 MB/s Jul 13 20:36:33 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a886c32c-e8c4-4c2c-9401-235eef2c0f27 is being set with open permissions: ugo+rw: NotImplementedError Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a886c32c-e8c4-4c2c-9401-235eef2c0f27 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:33 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0 Jul 13 20:36:33 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:33 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a886c32c-e8c4-4c2c-9401-235eef2c0f27 Jul 13 20:36:33 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:33 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0376604d-48c1-4dde-a219-1c82166f30e0" returned: 0 in 0.279s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:33 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a886c32c-e8c4-4c2c-9401-235eef2c0f27" returned: 0 in 0.294s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-quobyte-0376604d-48c1-4dde-a219-1c82166f30e0" released by "delete_volume" :: held 0.790s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Lock "cinder-quobyte-a886c32c-e8c4-4c2c-9401-235eef2c0f27" released by "_copy_volume_from_snapshot" :: held 7.701s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Acquiring lock "cinder-quobyte-c6480f0d-5af8-424c-91bb-8942effd4c0c" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Lock "cinder-quobyte-c6480f0d-5af8-424c-91bb-8942effd4c0c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Deleting offline snapshot c6480f0d-5af8-424c-91bb-8942effd4c0c of volume e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] snapshot_file for this snap is: volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb24c8c5-2bef-4465-b429-b9a3e5ab74c1]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] Created reservations ['088d83b3-f9e0-4a88-81fd-d2395420f7c7', 'bf4621f3-1071-44c5-8a7e-6e7b7a690147', 'fe73eb8f-44a0-4871-be55-4968b279b5a7', '6858ba1c-b9d4-428b-8de7-109b8eca3c3f'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:33 devstack sudo[94552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c Jul 13 20:36:33 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:33 devstack sudo[94553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:36:33 devstack sudo[94553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:34 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c" returned: 0 in 0.429s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:36:34 devstack sudo[94553]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.354s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:34 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:36:34 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dd7cb1-999a-4572-8846-45063ba7aafb]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:34 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] Deleted volume successfully. Jul 13 20:36:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a91e9f04-63f4-4bf3-9d0d-375e717fc3e9 tempest-VolumesSnapshotTestJSON-233593282 None] Lock "cinder-0376604d-48c1-4dde-a219-1c82166f30e0-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:34 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d Jul 13 20:36:34 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:34 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d" returned: 0 in 0.400s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:34 devstack sudo[94566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c Jul 13 20:36:34 devstack sudo[94566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:35 devstack sudo[94566]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c" returned: 0 in 0.482s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:35 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c Jul 13 20:36:35 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:35 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d.c6480f0d-5af8-424c-91bb-8942effd4c0c" returned: 0 in 0.280s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Lock "cinder-quobyte-c6480f0d-5af8-424c-91bb-8942effd4c0c" released by "_delete_snapshot" :: held 1.714s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.714s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.413s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:36:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1333305707',display_name='tempest-VolumesGetTest-Volume-989989516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1935be15-9aa0-4e30-a722-2bb94420365b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c79e3744b2b2434e87ed6111c427241d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:36:18Z,use_quota=True,user_id='7ebb2e11953e4765b995ebceb75fabf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:36:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Creating volume 1935be15-9aa0-4e30-a722-2bb94420365b {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:36:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:36:35 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:36:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1935be15-9aa0-4e30-a722-2bb94420365b 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:35 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1935be15-9aa0-4e30-a722-2bb94420365b 1073741824 Jul 13 20:36:35 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:35 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-49d3829d-0c12-4f05-9a81-60819b6b9785 tempest-GroupsV314Test-1379685677 None] Create group from source-group-60f4c443-baaf-41fd-9488-3d6b00d9a207 completed successfully. Jul 13 20:36:35 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1935be15-9aa0-4e30-a722-2bb94420365b 1073741824" returned: 0 in 0.500s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1935be15-9aa0-4e30-a722-2bb94420365b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:36 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1935be15-9aa0-4e30-a722-2bb94420365b Jul 13 20:36:36 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:36 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1935be15-9aa0-4e30-a722-2bb94420365b" returned: 0 in 0.368s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:36:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac9d0984-f48a-490d-8259-b47eab360bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1935be15-9aa0-4e30-a722-2bb94420365b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1409baf9-ad81-46b7-9406-1e621aefc18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:36 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Volume volume-1935be15-9aa0-4e30-a722-2bb94420365b (1935be15-9aa0-4e30-a722-2bb94420365b): created successfully Jul 13 20:36:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1409baf9-ad81-46b7-9406-1e621aefc18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Flow 'volume_create_manager' (42f62563-9a2c-4174-bf8f-61dd05182b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:36:36 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ba138ce3-8ca3-41cc-a8ad-02704f262fbb tempest-VolumesGetTest-1999897006 None] Created volume successfully. Jul 13 20:36:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] Acquiring lock "cinder-quobyte-a886c32c-e8c4-4c2c-9401-235eef2c0f27" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] Lock "cinder-quobyte-a886c32c-e8c4-4c2c-9401-235eef2c0f27" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:37 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6e8f07-f9da-4a53-85a0-5fd4ede2d606]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a886c32c-e8c4-4c2c-9401-235eef2c0f27 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:37 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a886c32c-e8c4-4c2c-9401-235eef2c0f27 Jul 13 20:36:37 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] Acquiring lock "cinder-1935be15-9aa0-4e30-a722-2bb94420365b-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] Lock "cinder-1935be15-9aa0-4e30-a722-2bb94420365b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] Acquiring lock "cinder-quobyte-1935be15-9aa0-4e30-a722-2bb94420365b" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] Lock "cinder-quobyte-1935be15-9aa0-4e30-a722-2bb94420365b" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:37 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b94ab1-5697-4701-86b0-7dbcdb2be4d9]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1935be15-9aa0-4e30-a722-2bb94420365b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:37 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a886c32c-e8c4-4c2c-9401-235eef2c0f27" returned: 0 in 0.562s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a886c32c-e8c4-4c2c-9401-235eef2c0f27 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:37 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a886c32c-e8c4-4c2c-9401-235eef2c0f27 Jul 13 20:36:37 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:37 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1935be15-9aa0-4e30-a722-2bb94420365b Jul 13 20:36:37 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:37 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a886c32c-e8c4-4c2c-9401-235eef2c0f27" returned: 0 in 0.350s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] Lock "cinder-quobyte-a886c32c-e8c4-4c2c-9401-235eef2c0f27" released by "delete_volume" :: held 0.986s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:37 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1935be15-9aa0-4e30-a722-2bb94420365b" returned: 0 in 0.456s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1935be15-9aa0-4e30-a722-2bb94420365b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:38 devstack sudo[94597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1935be15-9aa0-4e30-a722-2bb94420365b Jul 13 20:36:38 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] Created reservations ['e1f5aabb-7050-4335-b801-458f8a58811f'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:36:38 devstack cinder-volume[87269]: WARNING cinder.quota [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1109339093 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1109339093, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:36:38 devstack cinder-volume[87269]: WARNING cinder.quota [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1109339093 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1109339093, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] Created reservations ['7babf058-729f-43b6-bbc0-038db043a4e5', '622a39e7-fe96-4a31-bf36-f7aecb94bf11', '73132050-4dc5-471d-8099-f93896196c9e', 'aa5d4e0a-cc34-432a-9834-84f4759a5447'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:38 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1935be15-9aa0-4e30-a722-2bb94420365b" returned: 0 in 0.387s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:38 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:36:38 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] Lock "cinder-quobyte-1935be15-9aa0-4e30-a722-2bb94420365b" released by "delete_volume" :: held 0.919s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] Created reservations ['936a96b0-f04a-4954-a244-e3d269940e0c', '3fa103e4-5ff2-4260-860d-0a6db151533e', 'adcc30d4-ed8c-4919-83e4-81ee6877f24a', '6303644f-a50f-443b-b716-cbbcb6aaf0b5'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:38 devstack sudo[94603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:36:38 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] Acquiring lock "cinder-23567bd2-6a00-42af-b419-79295d5625aa-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] Lock "cinder-23567bd2-6a00-42af-b419-79295d5625aa-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:38 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.532s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:36:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-52293d38-c43e-4c59-8665-4f6f38ff5a98 tempest-GroupsV314Test-1379685677 None] Delete group completed successfully. Jul 13 20:36:38 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.369s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:36:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] Deleted volume successfully. Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] Acquiring lock "cinder-quobyte-23567bd2-6a00-42af-b419-79295d5625aa" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] Lock "cinder-quobyte-23567bd2-6a00-42af-b419-79295d5625aa" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c7ee0af-1685-44a9-b873-c7ac4a18287d tempest-VolumesGetTest-1999897006 None] Lock "cinder-1935be15-9aa0-4e30-a722-2bb94420365b-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:39 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4f6173-1f73-472d-803b-b2ec8e14ea10]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-23567bd2-6a00-42af-b419-79295d5625aa {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:39 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-23567bd2-6a00-42af-b419-79295d5625aa Jul 13 20:36:39 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:39 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-23567bd2-6a00-42af-b419-79295d5625aa" returned: 0 in 0.480s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-23567bd2-6a00-42af-b419-79295d5625aa {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:39 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-23567bd2-6a00-42af-b419-79295d5625aa Jul 13 20:36:39 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b9aa59e2-440c-420c-a569-c48d5b2be45b tempest-GroupsV314Test-1379685677 None] Acquiring lock "cinder-quobyte-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b9aa59e2-440c-420c-a569-c48d5b2be45b tempest-GroupsV314Test-1379685677 None] Lock "cinder-quobyte-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d" acquired by "delete_volume" :: waited 0.048s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:39 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31d6217-e12f-4871-adf2-6436d4703d73]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9aa59e2-440c-420c-a569-c48d5b2be45b tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:39 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-23567bd2-6a00-42af-b419-79295d5625aa" returned: 0 in 0.423s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] Lock "cinder-quobyte-23567bd2-6a00-42af-b419-79295d5625aa" released by "delete_volume" :: held 0.976s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:40 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] Created reservations ['af4c13ef-3cc9-4919-b1e7-7d0969d6bb87', 'e3a246b5-94e8-4153-a867-9512553be3cd', 'c96206b1-3226-46cd-9ec8-0a42d3ab023b', '5908b124-702e-465b-9c94-ee7b850f8d95'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:36:40 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d Jul 13 20:36:40 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:40 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:36:40 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:40 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.295s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:40 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:36:40 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:40 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] Deleted volume successfully. Jul 13 20:36:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9aa59e2-440c-420c-a569-c48d5b2be45b tempest-GroupsV314Test-1379685677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d" returned: 0 in 0.539s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9aa59e2-440c-420c-a569-c48d5b2be45b tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:40 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d Jul 13 20:36:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5d36e3e5-aa15-4fa2-8956-431c2c56b439 tempest-VolumesGetTest-1999897006 None] Lock "cinder-23567bd2-6a00-42af-b419-79295d5625aa-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:40 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:40 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9aa59e2-440c-420c-a569-c48d5b2be45b tempest-GroupsV314Test-1379685677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d" returned: 0 in 0.299s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b9aa59e2-440c-420c-a569-c48d5b2be45b tempest-GroupsV314Test-1379685677 None] Lock "cinder-quobyte-e8b3e1d6-a5ee-45fc-91fa-e3d77af3d21d" released by "delete_volume" :: held 0.944s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:40 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-b9aa59e2-440c-420c-a569-c48d5b2be45b tempest-GroupsV314Test-1379685677 None] Created reservations ['d8c2af6c-fc4f-42b5-b108-9cbca9d6c56e'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:36:40 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-b9aa59e2-440c-420c-a569-c48d5b2be45b tempest-GroupsV314Test-1379685677 None] Created reservations ['1aadd80e-ba88-4812-8915-b8b2c2a98628', '6a78fbf9-bfb1-4056-b418-49be457dc637', 'b5710006-0600-4fe8-9971-631bc6e4f322', '8eee430c-91ca-4efd-9fcc-524705395ec2'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:36:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b9aa59e2-440c-420c-a569-c48d5b2be45b tempest-GroupsV314Test-1379685677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b9aa59e2-440c-420c-a569-c48d5b2be45b tempest-GroupsV314Test-1379685677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b9aa59e2-440c-420c-a569-c48d5b2be45b tempest-GroupsV314Test-1379685677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b9aa59e2-440c-420c-a569-c48d5b2be45b tempest-GroupsV314Test-1379685677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b9aa59e2-440c-420c-a569-c48d5b2be45b tempest-GroupsV314Test-1379685677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9aa59e2-440c-420c-a569-c48d5b2be45b tempest-GroupsV314Test-1379685677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:41 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:36:41 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:41 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9aa59e2-440c-420c-a569-c48d5b2be45b tempest-GroupsV314Test-1379685677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.399s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:41 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-b9aa59e2-440c-420c-a569-c48d5b2be45b tempest-GroupsV314Test-1379685677 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:36:41 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b9aa59e2-440c-420c-a569-c48d5b2be45b tempest-GroupsV314Test-1379685677 None] Delete group completed successfully. Jul 13 20:36:41 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:36:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Flow 'volume_create_manager' (39e2b4ef-99c2-4f04-ab1e-15b64ec2203f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:36:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0614f114-41dd-4ddb-a056-f32737245141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0614f114-41dd-4ddb-a056-f32737245141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1251217882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e062272b-7019-4ae7-be2a-c2987e30f958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c79e3744b2b2434e87ed6111c427241d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:36:42Z,use_quota=True,user_id='7ebb2e11953e4765b995ebceb75fabf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a03455b-2248-4519-9364-0732f88cc486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a03455b-2248-4519-9364-0732f88cc486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ca4b9f-9d12-4b0e-b25d-50b8a27f0174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ca4b9f-9d12-4b0e-b25d-50b8a27f0174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e062272b-7019-4ae7-be2a-c2987e30f958', 'volume_name': 'volume-e062272b-7019-4ae7-be2a-c2987e30f958', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016d192c-50d6-4069-a2b4-082ee9261329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016d192c-50d6-4069-a2b4-082ee9261329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b86b67-9de8-442f-aecc-658b578bad6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:42 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Volume e062272b-7019-4ae7-be2a-c2987e30f958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e062272b-7019-4ae7-be2a-c2987e30f958', 'volume_size': 1} Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1251217882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e062272b-7019-4ae7-be2a-c2987e30f958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c79e3744b2b2434e87ed6111c427241d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:36:42Z,use_quota=True,user_id='7ebb2e11953e4765b995ebceb75fabf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Creating volume e062272b-7019-4ae7-be2a-c2987e30f958 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:36:42 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:42 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 1073741824 Jul 13 20:36:42 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:42 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 1073741824" returned: 0 in 0.585s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:42 devstack sudo[94637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 Jul 13 20:36:42 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:43 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958" returned: 0 in 0.277s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:36:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b86b67-9de8-442f-aecc-658b578bad6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e062272b-7019-4ae7-be2a-c2987e30f958', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95418c3-e799-4bd6-b937-d1ef7762d9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:43 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Volume volume-e062272b-7019-4ae7-be2a-c2987e30f958 (e062272b-7019-4ae7-be2a-c2987e30f958): created successfully Jul 13 20:36:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95418c3-e799-4bd6-b937-d1ef7762d9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Flow 'volume_create_manager' (39e2b4ef-99c2-4f04-ab1e-15b64ec2203f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:36:43 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-25f60deb-05cd-4f0e-807e-e615dc2b315c tempest-VolumesGetTest-1999897006 None] Created volume successfully. Jul 13 20:36:44 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:36:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Flow 'volume_create_manager' (3bdf9f04-dfb9-4d11-a42b-645f9be8069b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:36:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5deca4-c678-4979-91c8-21eeea3a48e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5deca4-c678-4979-91c8-21eeea3a48e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-694125880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bbd6bac-64f4-4b41-902d-e6c88eba3adf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c79e3744b2b2434e87ed6111c427241d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e062272b-7019-4ae7-be2a-c2987e30f958,status='creating',terminated_at=None,updated_at=2026-07-13T18:36:44Z,use_quota=True,user_id='7ebb2e11953e4765b995ebceb75fabf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59026fed-754f-476b-b9cc-b31c0c6a4316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59026fed-754f-476b-b9cc-b31c0c6a4316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc51c921-11f6-41ed-943d-2437a45d8083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc51c921-11f6-41ed-943d-2437a45d8083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8bbd6bac-64f4-4b41-902d-e6c88eba3adf', 'volume_name': 'volume-8bbd6bac-64f4-4b41-902d-e6c88eba3adf', 'volume_size': 1, 'source_volid': 'e062272b-7019-4ae7-be2a-c2987e30f958', 'source_volstatus': 'available'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322e48db-72e0-4274-8cad-fee64a318ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322e48db-72e0-4274-8cad-fee64a318ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840688f6-27cf-4a00-b268-63384e815132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:44 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Volume 8bbd6bac-64f4-4b41-902d-e6c88eba3adf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8bbd6bac-64f4-4b41-902d-e6c88eba3adf', 'volume_size': 1, 'source_volid': 'e062272b-7019-4ae7-be2a-c2987e30f958', 'source_volstatus': 'available'} Jul 13 20:36:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:44 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Cloning volume e062272b-7019-4ae7-be2a-c2987e30f958 to volume 8bbd6bac-64f4-4b41-902d-e6c88eba3adf Jul 13 20:36:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Creating offline snapshot a6b52f60-be14-4717-a96e-36fdb89b288e of volume e062272b-7019-4ae7-be2a-c2987e30f958 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:36:44 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebe58fe-8bb0-41aa-8557-1acf5adcf0a0]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:44 devstack sudo[94677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 Jul 13 20:36:44 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:45 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958" returned: 0 in 0.493s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:45 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e 1G Jul 13 20:36:45 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:45 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e 1G" returned: 0 in 0.574s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e062272b-7019-4ae7-be2a-c2987e30f958 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:45 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e062272b-7019-4ae7-be2a-c2987e30f958 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e Jul 13 20:36:45 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:46 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e062272b-7019-4ae7-be2a-c2987e30f958 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e" returned: 0 in 0.384s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:46 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e is being set with open permissions: ugo+rw Jul 13 20:36:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:46 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e Jul 13 20:36:46 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:46 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e" returned: 0 in 0.291s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:46 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.info Jul 13 20:36:46 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:46 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.info" returned: 0 in 0.319s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:46 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.info is being set with open permissions: ugo+rw Jul 13 20:36:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:46 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.info Jul 13 20:36:46 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:47 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.info" returned: 0 in 0.288s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Acquiring lock "cinder-quobyte-8bbd6bac-64f4-4b41-902d-e6c88eba3adf" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Lock "cinder-quobyte-8bbd6bac-64f4-4b41-902d-e6c88eba3adf" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] snapshot: a6b52f60-be14-4717-a96e-36fdb89b288e, volume: 8bbd6bac-64f4-4b41-902d-e6c88eba3adf, {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 20:36:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:36:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:36:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:36:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:36:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:47 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2a522a-118d-493a-84e9-41336eaafa2c]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:47 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e Jul 13 20:36:47 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:47 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e" returned: 0 in 0.462s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e062272b-7019-4ae7-be2a-c2987e30f958(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:36:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 20:36:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 20:36:47 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[860d2cf7-7775-4fba-97ff-681367d89cfd]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:47 devstack sudo[94707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 Jul 13 20:36:47 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:48 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958" returned: 0 in 0.534s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:48 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Path /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8bbd6bac-64f4-4b41-902d-e6c88eba3adf not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 20:36:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8bbd6bac-64f4-4b41-902d-e6c88eba3adf {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:48 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8bbd6bac-64f4-4b41-902d-e6c88eba3adf Jul 13 20:36:48 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:54 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8bbd6bac-64f4-4b41-902d-e6c88eba3adf" returned: 0 in 6.446s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:54 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a699a9a1-1a56-4247-9d7e-adb6b5a5fa8f]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:54 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 Jul 13 20:36:54 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:55 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958" returned: 0 in 0.881s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:55 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958, size 1024.00 MB, duration 6.45 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8bbd6bac-64f4-4b41-902d-e6c88eba3adf {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:36:55 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Converted 1024.00 MB image at 158.83 MB/s Jul 13 20:36:55 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8bbd6bac-64f4-4b41-902d-e6c88eba3adf is being set with open permissions: ugo+rw Jul 13 20:36:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8bbd6bac-64f4-4b41-902d-e6c88eba3adf {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:55 devstack sudo[94742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8bbd6bac-64f4-4b41-902d-e6c88eba3adf Jul 13 20:36:55 devstack sudo[94742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:55 devstack sudo[94742]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8bbd6bac-64f4-4b41-902d-e6c88eba3adf" returned: 0 in 0.399s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Lock "cinder-quobyte-8bbd6bac-64f4-4b41-902d-e6c88eba3adf" released by "_copy_volume_from_snapshot" :: held 8.840s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:55 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=145,cinder:UPDATE=173,cinder:INSERT=39,cinder:DELETE=11 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:36:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Acquiring lock "cinder-quobyte-a6b52f60-be14-4717-a96e-36fdb89b288e" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:36:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Lock "cinder-quobyte-a6b52f60-be14-4717-a96e-36fdb89b288e" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:36:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Deleting offline snapshot a6b52f60-be14-4717-a96e-36fdb89b288e of volume e062272b-7019-4ae7-be2a-c2987e30f958 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:36:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] snapshot_file for this snap is: volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:36:56 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2097b43f-2754-4022-be72-6ce05ed85ba4]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:56 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e Jul 13 20:36:56 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:56 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=174,cinder:SELECT=145,cinder:INSERT=47,cinder:DELETE=11 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:36:56 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e" returned: 0 in 0.537s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e062272b-7019-4ae7-be2a-c2987e30f958(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:36:56 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a04fa3b-7552-41d8-a305-0bdfffbfa20c]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:36:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:56 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 Jul 13 20:36:56 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:57 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958" returned: 0 in 0.443s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:57 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e Jul 13 20:36:57 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:57 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e" returned: 0 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:36:57 devstack sudo[94778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e Jul 13 20:36:57 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:36:57 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root Jul 13 20:36:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958.a6b52f60-be14-4717-a96e-36fdb89b288e" returned: 0 in 0.378s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:36:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Lock "cinder-quobyte-a6b52f60-be14-4717-a96e-36fdb89b288e" released by "_delete_snapshot" :: held 1.889s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:36:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.342s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:36:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840688f6-27cf-4a00-b268-63384e815132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bbd6bac-64f4-4b41-902d-e6c88eba3adf', 'volume_size': 1, 'source_volid': 'e062272b-7019-4ae7-be2a-c2987e30f958', 'source_volstatus': 'available'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25e4499-fc23-4c56-9fd1-99d53e28eb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:36:58 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Volume volume-8bbd6bac-64f4-4b41-902d-e6c88eba3adf (8bbd6bac-64f4-4b41-902d-e6c88eba3adf): created successfully Jul 13 20:36:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25e4499-fc23-4c56-9fd1-99d53e28eb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:36:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Flow 'volume_create_manager' (3bdf9f04-dfb9-4d11-a42b-645f9be8069b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:36:58 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4cb577c1-b747-4b17-ac92-17fa0de9c3cc tempest-VolumesGetTest-1999897006 None] Created volume successfully. Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Flow 'volume_create_manager' (6f84c2cf-cabf-4c28-b3e6-96a520f42609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bbc5200-740c-4745-8197-cde917a9562d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bbc5200-740c-4745-8197-cde917a9562d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1677771358',display_name='tempest-VolumesGetTest-Volume-1644650814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94f5725-7dc9-4b55-a41e-56884326ab69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c79e3744b2b2434e87ed6111c427241d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:00Z,use_quota=True,user_id='7ebb2e11953e4765b995ebceb75fabf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e605d7ca-13d7-44db-82d8-06364b6071f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e605d7ca-13d7-44db-82d8-06364b6071f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da0a2ce-ee92-4682-a392-b304090c9f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da0a2ce-ee92-4682-a392-b304090c9f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a94f5725-7dc9-4b55-a41e-56884326ab69', 'volume_name': 'volume-a94f5725-7dc9-4b55-a41e-56884326ab69', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded659a6-306e-4bd5-bc6c-140d3484523e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded659a6-306e-4bd5-bc6c-140d3484523e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bcfcc02-ef0c-4844-9aa5-0960b057604b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:00 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Volume a94f5725-7dc9-4b55-a41e-56884326ab69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a94f5725-7dc9-4b55-a41e-56884326ab69', 'volume_size': 1} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1677771358',display_name='tempest-VolumesGetTest-Volume-1644650814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94f5725-7dc9-4b55-a41e-56884326ab69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c79e3744b2b2434e87ed6111c427241d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:00Z,use_quota=True,user_id='7ebb2e11953e4765b995ebceb75fabf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Creating volume a94f5725-7dc9-4b55-a41e-56884326ab69 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:37:00 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a94f5725-7dc9-4b55-a41e-56884326ab69 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:00 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a94f5725-7dc9-4b55-a41e-56884326ab69 1073741824 Jul 13 20:37:00 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:00 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a94f5725-7dc9-4b55-a41e-56884326ab69 1073741824" returned: 0 in 0.605s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a94f5725-7dc9-4b55-a41e-56884326ab69 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:00 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a94f5725-7dc9-4b55-a41e-56884326ab69 Jul 13 20:37:00 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:01 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a94f5725-7dc9-4b55-a41e-56884326ab69" returned: 0 in 0.393s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:37:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bcfcc02-ef0c-4844-9aa5-0960b057604b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a94f5725-7dc9-4b55-a41e-56884326ab69', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b7e5cf-a436-4b34-81d2-294aab7f4811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:01 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Volume volume-a94f5725-7dc9-4b55-a41e-56884326ab69 (a94f5725-7dc9-4b55-a41e-56884326ab69): created successfully Jul 13 20:37:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b7e5cf-a436-4b34-81d2-294aab7f4811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Flow 'volume_create_manager' (6f84c2cf-cabf-4c28-b3e6-96a520f42609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:01 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a9ffc701-887f-4c44-8062-080de83a7056 tempest-VolumesGetTest-1999897006 None] Created volume successfully. Jul 13 20:37:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] Acquiring lock "cinder-a94f5725-7dc9-4b55-a41e-56884326ab69-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] Lock "cinder-a94f5725-7dc9-4b55-a41e-56884326ab69-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] Acquiring lock "cinder-quobyte-a94f5725-7dc9-4b55-a41e-56884326ab69" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] Lock "cinder-quobyte-a94f5725-7dc9-4b55-a41e-56884326ab69" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:02 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed96fb87-29f2-43a2-82f2-df2a70410ac4]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:37:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a94f5725-7dc9-4b55-a41e-56884326ab69 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:03 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a94f5725-7dc9-4b55-a41e-56884326ab69 Jul 13 20:37:03 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:03 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a94f5725-7dc9-4b55-a41e-56884326ab69" returned: 0 in 0.588s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a94f5725-7dc9-4b55-a41e-56884326ab69 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:03 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a94f5725-7dc9-4b55-a41e-56884326ab69 Jul 13 20:37:03 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:03 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a94f5725-7dc9-4b55-a41e-56884326ab69" returned: 0 in 0.350s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] Lock "cinder-quobyte-a94f5725-7dc9-4b55-a41e-56884326ab69" released by "delete_volume" :: held 1.047s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:37:03 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] Created reservations ['a3e7daa1-7868-4b59-9097-3f551027e209', '9968ad3c-918c-4297-93f3-d93dfbfc61f0', '24c8f19a-4b60-483a-8823-8368ac25f2d4', '3c5d4f4d-8d7b-467e-9f04-6feb1c0a418c'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:37:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:04 devstack sudo[94869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:37:04 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:04 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.309s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:04 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:37:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] Deleted volume successfully. Jul 13 20:37:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4c106ed7-9d63-4d98-ac88-f6fc94cb342f tempest-VolumesGetTest-1999897006 None] Lock "cinder-a94f5725-7dc9-4b55-a41e-56884326ab69-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:37:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] Acquiring lock "cinder-8bbd6bac-64f4-4b41-902d-e6c88eba3adf-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] Lock "cinder-8bbd6bac-64f4-4b41-902d-e6c88eba3adf-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] Acquiring lock "cinder-quobyte-8bbd6bac-64f4-4b41-902d-e6c88eba3adf" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] Lock "cinder-quobyte-8bbd6bac-64f4-4b41-902d-e6c88eba3adf" acquired by "delete_volume" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b1ab8a-5081-4511-87c6-82faf7a3db3a]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:37:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8bbd6bac-64f4-4b41-902d-e6c88eba3adf {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:05 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8bbd6bac-64f4-4b41-902d-e6c88eba3adf Jul 13 20:37:05 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:05 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8bbd6bac-64f4-4b41-902d-e6c88eba3adf" returned: 0 in 0.463s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8bbd6bac-64f4-4b41-902d-e6c88eba3adf {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:05 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8bbd6bac-64f4-4b41-902d-e6c88eba3adf Jul 13 20:37:05 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:06 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8bbd6bac-64f4-4b41-902d-e6c88eba3adf" returned: 0 in 0.375s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] Lock "cinder-quobyte-8bbd6bac-64f4-4b41-902d-e6c88eba3adf" released by "delete_volume" :: held 0.921s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:37:06 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] Created reservations ['92508c82-88bc-4a62-a806-d2b5b67c3590', 'de6c8db0-b21f-4224-90ff-51f58431f25f', '92aa8b8f-9f9e-444e-b0f5-76e8af53dc5a', 'b661505d-f82d-423a-85de-6634d4b04ec2'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:37:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:06 devstack sudo[94880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:37:06 devstack sudo[94880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:06 devstack sudo[94880]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.493s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:06 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:37:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] Deleted volume successfully. Jul 13 20:37:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec44aa71-d609-415c-81a9-d7ae7ba90fc8 tempest-VolumesGetTest-1999897006 None] Lock "cinder-8bbd6bac-64f4-4b41-902d-e6c88eba3adf-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:37:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] Acquiring lock "cinder-e062272b-7019-4ae7-be2a-c2987e30f958-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] Lock "cinder-e062272b-7019-4ae7-be2a-c2987e30f958-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] Acquiring lock "cinder-quobyte-e062272b-7019-4ae7-be2a-c2987e30f958" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] Lock "cinder-quobyte-e062272b-7019-4ae7-be2a-c2987e30f958" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:07 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9f1d87-d55f-4754-9032-6de61bded618]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:37:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:07 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 Jul 13 20:37:07 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:08 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958" returned: 0 in 0.574s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:08 devstack sudo[94888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958 Jul 13 20:37:08 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:08 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e062272b-7019-4ae7-be2a-c2987e30f958" returned: 0 in 0.360s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] Lock "cinder-quobyte-e062272b-7019-4ae7-be2a-c2987e30f958" released by "delete_volume" :: held 1.110s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:37:08 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] Created reservations ['3636431d-fde9-4871-8914-0b573970e861', '74a990d9-24dc-46b1-8b02-b1d210b21336', '7bccd449-08b5-408e-812f-55a20674b138', '197fd21f-5e7e-4997-8f54-3802b52d0957'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:37:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:09 devstack sudo[94891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:37:09 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:09 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.598s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:09 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:37:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] Deleted volume successfully. Jul 13 20:37:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b5dded7b-d453-4d66-804f-9b2b2d5373a5 tempest-VolumesGetTest-1999897006 None] Lock "cinder-e062272b-7019-4ae7-be2a-c2987e30f958-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Flow 'volume_create_manager' (6f20280c-c7c9-4233-84c4-fa71cb0ddcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc5f190-0fc3-4bc8-9575-8a44163b184b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc5f190-0fc3-4bc8-9575-8a44163b184b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-778309162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8949326a-2562-4516-aab6-757bb688f728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24b803498fb49aab4769421ae541003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:11Z,use_quota=True,user_id='05726a8da50145eda7e1571c6c4f585d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6101378-2999-485d-8921-a95127135421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6101378-2999-485d-8921-a95127135421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184a64eb-f659-44ed-be9f-5ed2893eba05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184a64eb-f659-44ed-be9f-5ed2893eba05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8949326a-2562-4516-aab6-757bb688f728', 'volume_name': 'volume-8949326a-2562-4516-aab6-757bb688f728', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e83c87d-55a7-4b01-b5f1-37aa5f77e539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e83c87d-55a7-4b01-b5f1-37aa5f77e539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7aa1e21-1506-4daa-a647-8156754109f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:11 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Volume 8949326a-2562-4516-aab6-757bb688f728: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8949326a-2562-4516-aab6-757bb688f728', 'volume_size': 1} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-778309162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8949326a-2562-4516-aab6-757bb688f728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24b803498fb49aab4769421ae541003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:11Z,use_quota=True,user_id='05726a8da50145eda7e1571c6c4f585d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Creating volume 8949326a-2562-4516-aab6-757bb688f728 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:37:11 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8949326a-2562-4516-aab6-757bb688f728 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:11 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8949326a-2562-4516-aab6-757bb688f728 1073741824 Jul 13 20:37:11 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Flow 'volume_create_manager' (36c70a77-da0c-4e78-9e0d-de863344df11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03d7daf-b59b-4a74-82ea-ca34c4685d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03d7daf-b59b-4a74-82ea-ca34c4685d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-576413512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c876849-e050-4b3d-afd6-4f9fa7d5f41d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c79e3744b2b2434e87ed6111c427241d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:12Z,use_quota=True,user_id='7ebb2e11953e4765b995ebceb75fabf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5b19c0-8a7d-4d76-b5ff-54d74bdd7cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5b19c0-8a7d-4d76-b5ff-54d74bdd7cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912bfd16-3b69-4638-9740-7bce87cb2171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:11 devstack cinder-volume[87269]: DEBUG cinder.image.glance [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Creating Keystone auth plugin from conf {{(pid=87269) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 13 20:37:12 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8949326a-2562-4516-aab6-757bb688f728 1073741824" returned: 0 in 0.813s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8949326a-2562-4516-aab6-757bb688f728 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:12 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8949326a-2562-4516-aab6-757bb688f728 Jul 13 20:37:12 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912bfd16-3b69-4638-9740-7bce87cb2171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3c876849-e050-4b3d-afd6-4f9fa7d5f41d', 'volume_name': 'volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d', 'volume_size': 1, 'image_id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6b4015e3a3db4a91ba2712f5d9c0002b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'created_at': datetime.datetime(2026, 7, 13, 18, 22, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5c85faa-ccd2-446c-ac1c-c871b5183834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad413f46-b9e5-43d9-8c4d-c19bc88942a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad413f46-b9e5-43d9-8c4d-c19bc88942a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9858c6e-3197-4be7-9f3e-154b73fd2974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:12 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Volume 3c876849-e050-4b3d-afd6-4f9fa7d5f41d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d', 'volume_size': 1, 'image_id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6b4015e3a3db4a91ba2712f5d9c0002b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'created_at': datetime.datetime(2026, 7, 13, 18, 22, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5c85faa-ccd2-446c-ac1c-c871b5183834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 13 20:37:12 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Trying to clone 3c876849-e050-4b3d-afd6-4f9fa7d5f41d from image a5c85faa-ccd2-446c-ac1c-c871b5183834 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}]). {{(pid=87269) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 13 20:37:12 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8949326a-2562-4516-aab6-757bb688f728" returned: 0 in 0.294s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:37:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7aa1e21-1506-4daa-a647-8156754109f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8949326a-2562-4516-aab6-757bb688f728', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44a5265-91c2-4224-84b6-366d91c82973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:12 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Volume volume-8949326a-2562-4516-aab6-757bb688f728 (8949326a-2562-4516-aab6-757bb688f728): created successfully Jul 13 20:37:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44a5265-91c2-4224-84b6-366d91c82973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Flow 'volume_create_manager' (6f20280c-c7c9-4233-84c4-fa71cb0ddcaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-57768510-5d96-4390-ad7e-eb43200c13ee tempest-VolumeQuotasNegativeTestJSON-570579835 None] Created volume successfully. Jul 13 20:37:12 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_em7sqgh6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 13 20:37:12 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Image download 20.69 MB at 20.69 MB/s Jul 13 20:37:12 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e998b0-bc03-45f6-af9f-fc45c982c982]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:37:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_em7sqgh6devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:13 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_em7sqgh6devstack@QuobyteHD Jul 13 20:37:13 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:13 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_em7sqgh6devstack@QuobyteHD" returned: 0 in 0.420s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:13 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Temporary image a5c85faa-ccd2-446c-ac1c-c871b5183834 is fetched for user 7ebb2e11953e4765b995ebceb75fabf2. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 13 20:37:13 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[023cf257-be0c-4b53-8ca1-2d36c70ea019]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:37:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_em7sqgh6devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:13 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_em7sqgh6devstack@QuobyteHD Jul 13 20:37:13 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:14 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_em7sqgh6devstack@QuobyteHD" returned: 0 in 0.615s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-576413512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c876849-e050-4b3d-afd6-4f9fa7d5f41d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c79e3744b2b2434e87ed6111c427241d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:12Z,use_quota=True,user_id='7ebb2e11953e4765b995ebceb75fabf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:37:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Creating volume 3c876849-e050-4b3d-afd6-4f9fa7d5f41d {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:37:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:37:14 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:37:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:14 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d 1073741824 Jul 13 20:37:14 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] Acquiring lock "cinder-8949326a-2562-4516-aab6-757bb688f728-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] Lock "cinder-8949326a-2562-4516-aab6-757bb688f728-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] Acquiring lock "cinder-quobyte-8949326a-2562-4516-aab6-757bb688f728" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] Lock "cinder-quobyte-8949326a-2562-4516-aab6-757bb688f728" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[737a21ce-4336-4932-8f8e-cfd2896cbcbb]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:37:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8949326a-2562-4516-aab6-757bb688f728 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:14 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8949326a-2562-4516-aab6-757bb688f728 Jul 13 20:37:14 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:14 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d 1073741824" returned: 0 in 0.831s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:15 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d Jul 13 20:37:15 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:15 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8949326a-2562-4516-aab6-757bb688f728" returned: 0 in 0.551s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8949326a-2562-4516-aab6-757bb688f728 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:15 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8949326a-2562-4516-aab6-757bb688f728 Jul 13 20:37:15 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:15 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d" returned: 0 in 0.367s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:37:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:15 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Attempting download of a5c85faa-ccd2-446c-ac1c-c871b5183834 ((None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}])) to volume 3c876849-e050-4b3d-afd6-4f9fa7d5f41d. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 13 20:37:15 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe1b4ae-fe8c-456a-ab2e-5c73c18c7b56]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:37:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_1oe40iwg {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:15 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8949326a-2562-4516-aab6-757bb688f728" returned: 0 in 0.464s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] Lock "cinder-quobyte-8949326a-2562-4516-aab6-757bb688f728" released by "delete_volume" :: held 1.114s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:37:15 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] Created reservations ['b3f71dee-115c-4c8e-88e3-078288bee5a4', '8817989a-e96e-4ae7-8198-69fd792f4abf', '46579444-cbac-423b-ae76-44320d454193', 'c02d7f87-6b59-481e-a3dd-68ecec5d0855'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:37:15 devstack sudo[94937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_1oe40iwg Jul 13 20:37:15 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:16 devstack sudo[94939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:37:16 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:16 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_1oe40iwg" returned: 0 in 0.720s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_1oe40iwg {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:16 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.348s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:16 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:37:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] Deleted volume successfully. Jul 13 20:37:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-28959fa9-913f-4d3a-ac79-61db49cea488 tempest-VolumeQuotasNegativeTestJSON-570579835 None] Lock "cinder-8949326a-2562-4516-aab6-757bb688f728-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:37:16 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_1oe40iwg Jul 13 20:37:16 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:16 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_1oe40iwg" returned: 1 in 0.504s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_1oe40iwg' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:37:16 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2131c07-881f-43d5-aeca-049c9fa588aa]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:37:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_em7sqgh6devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:16 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_em7sqgh6devstack@QuobyteHD Jul 13 20:37:16 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:17 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_em7sqgh6devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:17 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] a5c85faa-ccd2-446c-ac1c-c871b5183834 was qcow2, converting to raw {{(pid=87269) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 13 20:37:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_em7sqgh6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:17 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_em7sqgh6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d Jul 13 20:37:17 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:37:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:18 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:37:18 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:19 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_em7sqgh6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d" returned: 0 in 1.827s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:19 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_em7sqgh6devstack@QuobyteHD, size 112.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:37:19 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Converted 112.00 MB image at 61.24 MB/s Jul 13 20:37:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:19 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d 1G Jul 13 20:37:19 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:19 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.372s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:37:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:37:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:37:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:37:19 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d 1G" returned: 0 in 0.366s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:19 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf7692f-29c7-4f6f-ae8f-f55a86fa4ed6]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:37:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:19 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d Jul 13 20:37:19 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:19 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d" returned: 0 in 0.412s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:20 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d Jul 13 20:37:20 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:20 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d" returned: 1 in 0.385s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:37:20 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Downloaded image a5c85faa-ccd2-446c-ac1c-c871b5183834 ((None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}])) to volume 3c876849-e050-4b3d-afd6-4f9fa7d5f41d successfully. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 13 20:37:20 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Temporary image a5c85faa-ccd2-446c-ac1c-c871b5183834 for user 7ebb2e11953e4765b995ebceb75fabf2 is deleted. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 13 20:37:20 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Marking volume 3c876849-e050-4b3d-afd6-4f9fa7d5f41d as bootable. {{(pid=87269) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 13 20:37:20 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Copying metadata from image a5c85faa-ccd2-446c-ac1c-c871b5183834 to 3c876849-e050-4b3d-afd6-4f9fa7d5f41d. {{(pid=87269) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 13 20:37:20 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Creating volume glance metadata for volume 3c876849-e050-4b3d-afd6-4f9fa7d5f41d backed by image a5c85faa-ccd2-446c-ac1c-c871b5183834 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87269) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 13 20:37:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9858c6e-3197-4be7-9f3e-154b73fd2974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d', 'volume_size': 1, 'image_id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6b4015e3a3db4a91ba2712f5d9c0002b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'created_at': datetime.datetime(2026, 7, 13, 18, 22, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5c85faa-ccd2-446c-ac1c-c871b5183834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8947fda7-eef9-4834-9b68-4297c0b8959e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:20 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Volume volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d (3c876849-e050-4b3d-afd6-4f9fa7d5f41d): created successfully Jul 13 20:37:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8947fda7-eef9-4834-9b68-4297c0b8959e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Flow 'volume_create_manager' (36c70a77-da0c-4e78-9e0d-de863344df11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0f597495-327a-4076-9c32-35d27c2151e8 tempest-VolumesGetTest-1999897006 None] Created volume successfully. Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Flow 'volume_create_manager' (66e6fcfa-c874-4d04-962e-bdf8105a7ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9559658-e603-4a24-9955-2f573a597309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9559658-e603-4a24-9955-2f573a597309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-714230243',display_name='tempest-VolumesGetTest-Volume-200639239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaad19b-21f7-446e-9170-25568c8d8026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c79e3744b2b2434e87ed6111c427241d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:22Z,use_quota=True,user_id='7ebb2e11953e4765b995ebceb75fabf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca085cc4-226e-4c23-99cf-a2fe2cf27dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca085cc4-226e-4c23-99cf-a2fe2cf27dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed86fb18-3480-4c4f-8877-37240e930044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed86fb18-3480-4c4f-8877-37240e930044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acaad19b-21f7-446e-9170-25568c8d8026', 'volume_name': 'volume-acaad19b-21f7-446e-9170-25568c8d8026', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d698c0c-1bef-4236-be0c-29a870112ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d698c0c-1bef-4236-be0c-29a870112ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a746b8-72f8-4af2-98d8-5e78009960e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:22 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Volume acaad19b-21f7-446e-9170-25568c8d8026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acaad19b-21f7-446e-9170-25568c8d8026', 'volume_size': 1} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-714230243',display_name='tempest-VolumesGetTest-Volume-200639239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaad19b-21f7-446e-9170-25568c8d8026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c79e3744b2b2434e87ed6111c427241d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:22Z,use_quota=True,user_id='7ebb2e11953e4765b995ebceb75fabf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Creating volume acaad19b-21f7-446e-9170-25568c8d8026 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:37:22 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:37:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-acaad19b-21f7-446e-9170-25568c8d8026 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:22 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-acaad19b-21f7-446e-9170-25568c8d8026 1073741824 Jul 13 20:37:22 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:23 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-acaad19b-21f7-446e-9170-25568c8d8026 1073741824" returned: 0 in 0.805s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-acaad19b-21f7-446e-9170-25568c8d8026 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:23 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-acaad19b-21f7-446e-9170-25568c8d8026 Jul 13 20:37:23 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:23 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:37:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Flow 'volume_create_manager' (6a6c56f1-83c5-4a8f-89b5-1e4b431d889f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b52b2f-93aa-44de-8949-e78dc06a3de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b52b2f-93aa-44de-8949-e78dc06a3de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-430501690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa3c350-600d-4e06-8a9c-a2008851ea5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48e9147244c4401a9b8eea8f65ee490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:24Z,use_quota=True,user_id='502f2f7829934d669aca2f6e6eeb1228',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd15b3c9-0639-4047-a3bf-351b33eb804a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd15b3c9-0639-4047-a3bf-351b33eb804a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5587178-7278-4d69-aed4-57afb58c7510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5587178-7278-4d69-aed4-57afb58c7510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa3c350-600d-4e06-8a9c-a2008851ea5f', 'volume_name': 'volume-daa3c350-600d-4e06-8a9c-a2008851ea5f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ac2853-91f3-434d-ba4b-a2f7bdece2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ac2853-91f3-434d-ba4b-a2f7bdece2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f85968-906f-435b-bb10-1c5c190a4dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:23 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Volume daa3c350-600d-4e06-8a9c-a2008851ea5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa3c350-600d-4e06-8a9c-a2008851ea5f', 'volume_size': 1} Jul 13 20:37:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:24 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-acaad19b-21f7-446e-9170-25568c8d8026" returned: 0 in 0.416s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.033s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-430501690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa3c350-600d-4e06-8a9c-a2008851ea5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48e9147244c4401a9b8eea8f65ee490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:24Z,use_quota=True,user_id='502f2f7829934d669aca2f6e6eeb1228',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Creating volume daa3c350-600d-4e06-8a9c-a2008851ea5f {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:37:24 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-daa3c350-600d-4e06-8a9c-a2008851ea5f 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a746b8-72f8-4af2-98d8-5e78009960e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acaad19b-21f7-446e-9170-25568c8d8026', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3958546e-d0d5-480b-819d-5c56c2ecb225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:24 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-daa3c350-600d-4e06-8a9c-a2008851ea5f 1073741824 Jul 13 20:37:24 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:24 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Volume volume-acaad19b-21f7-446e-9170-25568c8d8026 (acaad19b-21f7-446e-9170-25568c8d8026): created successfully Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3958546e-d0d5-480b-819d-5c56c2ecb225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Flow 'volume_create_manager' (66e6fcfa-c874-4d04-962e-bdf8105a7ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:24 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d6bddd73-5960-4cce-8c61-8872d4b3f668 tempest-VolumesGetTest-1999897006 None] Created volume successfully. Jul 13 20:37:24 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-daa3c350-600d-4e06-8a9c-a2008851ea5f 1073741824" returned: 0 in 0.642s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-daa3c350-600d-4e06-8a9c-a2008851ea5f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:24 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-daa3c350-600d-4e06-8a9c-a2008851ea5f Jul 13 20:37:24 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] Acquiring lock "cinder-acaad19b-21f7-446e-9170-25568c8d8026-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] Lock "cinder-acaad19b-21f7-446e-9170-25568c8d8026-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] Acquiring lock "cinder-quobyte-acaad19b-21f7-446e-9170-25568c8d8026" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] Lock "cinder-quobyte-acaad19b-21f7-446e-9170-25568c8d8026" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:25 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1faa8f6c-6135-4c0f-908d-a0c44743658f]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:37:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-acaad19b-21f7-446e-9170-25568c8d8026 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:25 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-daa3c350-600d-4e06-8a9c-a2008851ea5f" returned: 0 in 0.417s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:37:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f85968-906f-435b-bb10-1c5c190a4dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa3c350-600d-4e06-8a9c-a2008851ea5f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e46db7-da67-4174-b843-54767cb2b229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:25 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Volume volume-daa3c350-600d-4e06-8a9c-a2008851ea5f (daa3c350-600d-4e06-8a9c-a2008851ea5f): created successfully Jul 13 20:37:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e46db7-da67-4174-b843-54767cb2b229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Flow 'volume_create_manager' (6a6c56f1-83c5-4a8f-89b5-1e4b431d889f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1af02dec-1713-4260-a054-a873478387e3 tempest-VolumesServicesTestJSON-135552711 None] Created volume successfully. Jul 13 20:37:25 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-acaad19b-21f7-446e-9170-25568c8d8026 Jul 13 20:37:25 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:25 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-acaad19b-21f7-446e-9170-25568c8d8026" returned: 0 in 0.480s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-acaad19b-21f7-446e-9170-25568c8d8026 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:25 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-acaad19b-21f7-446e-9170-25568c8d8026 Jul 13 20:37:25 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:26 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-acaad19b-21f7-446e-9170-25568c8d8026" returned: 0 in 0.474s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] Lock "cinder-quobyte-acaad19b-21f7-446e-9170-25568c8d8026" released by "delete_volume" :: held 0.999s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:37:26 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] Created reservations ['061ad2dc-fa0a-4619-94f1-511c322afd62', '3abe60c6-9649-4f7e-b572-fdbd7fd2e7b1', '25655ba9-52ae-4295-82f7-eb4fe2be82c8', '9dde8026-d58c-4b87-b3d3-37fab0b906c1'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:37:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] Acquiring lock "cinder-daa3c350-600d-4e06-8a9c-a2008851ea5f-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] Lock "cinder-daa3c350-600d-4e06-8a9c-a2008851ea5f-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:26 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:37:26 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] Acquiring lock "cinder-quobyte-daa3c350-600d-4e06-8a9c-a2008851ea5f" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] Lock "cinder-quobyte-daa3c350-600d-4e06-8a9c-a2008851ea5f" acquired by "delete_volume" :: waited 0.051s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[302afb79-e231-416b-bc2d-a944b3d08300]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:37:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-daa3c350-600d-4e06-8a9c-a2008851ea5f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:26 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-daa3c350-600d-4e06-8a9c-a2008851ea5f Jul 13 20:37:26 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:26 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.528s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:26 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:37:26 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] Deleted volume successfully. Jul 13 20:37:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-203d16df-db01-416b-91c8-1684e2b22d2a tempest-VolumesGetTest-1999897006 None] Lock "cinder-acaad19b-21f7-446e-9170-25568c8d8026-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:37:27 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-daa3c350-600d-4e06-8a9c-a2008851ea5f" returned: 0 in 0.657s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-daa3c350-600d-4e06-8a9c-a2008851ea5f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:27 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-daa3c350-600d-4e06-8a9c-a2008851ea5f Jul 13 20:37:27 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] Acquiring lock "cinder-3c876849-e050-4b3d-afd6-4f9fa7d5f41d-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] Lock "cinder-3c876849-e050-4b3d-afd6-4f9fa7d5f41d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] Acquiring lock "cinder-quobyte-3c876849-e050-4b3d-afd6-4f9fa7d5f41d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] Lock "cinder-quobyte-3c876849-e050-4b3d-afd6-4f9fa7d5f41d" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:27 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1787baed-5768-4efa-b869-984fb38a7428]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:37:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:27 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-daa3c350-600d-4e06-8a9c-a2008851ea5f" returned: 0 in 0.371s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] Lock "cinder-quobyte-daa3c350-600d-4e06-8a9c-a2008851ea5f" released by "delete_volume" :: held 1.122s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:37:27 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d Jul 13 20:37:27 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:27 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] Created reservations ['49c3f03e-2789-4521-a28d-5fcfd59aa4de', '0215b8fd-76d2-46e9-bb17-68b7eb72060b', 'aa00dd72-f8df-4a2c-8df6-d5e91378df8b', 'dd250ea4-ca4e-46ac-8fce-a754effe0a16'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:37:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:27 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:37:27 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:28 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d" returned: 0 in 0.548s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:28 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.311s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:28 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:37:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] Deleted volume successfully. Jul 13 20:37:28 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d Jul 13 20:37:28 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7166821c-40d2-4657-80ad-4236915f0376 tempest-VolumesServicesTestJSON-135552711 None] Lock "cinder-daa3c350-600d-4e06-8a9c-a2008851ea5f-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:37:28 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d" returned: 1 in 0.430s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:37:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:28 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d Jul 13 20:37:28 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:28 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3c876849-e050-4b3d-afd6-4f9fa7d5f41d" returned: 0 in 0.324s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] Lock "cinder-quobyte-3c876849-e050-4b3d-afd6-4f9fa7d5f41d" released by "delete_volume" :: held 1.406s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:37:28 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] Created reservations ['d2c545e6-644b-422b-ba21-55a10f67bcce', '778e7b78-ea3e-4626-b7a9-7caa4c1d0c0d', '3f372eb9-f0eb-420c-961c-a8dc46ce6715', 'c2c41936-f125-4db7-ab99-c84b9565951c'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:29 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:37:29 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:29 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.358s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:37:29 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] Deleted volume successfully. Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92989cc4-5f7d-40d3-9ebf-aedaaaaa5ba8 tempest-VolumesGetTest-1999897006 None] Lock "cinder-3c876849-e050-4b3d-afd6-4f9fa7d5f41d-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Flow 'volume_create_manager' (75ec25d2-66dd-44f2-a843-323a126d2d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2eeb8a5-de11-408a-b707-515ad7796bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2eeb8a5-de11-408a-b707-515ad7796bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1206878653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24778fc-474a-45e0-85b1-72cae16452a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e0c94d4aa14c3b917ab885814e9277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:30Z,use_quota=True,user_id='60be7218b2e94538a8c421c4f94a7b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c94a06-4a97-4146-8ebb-31f5effc9c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c94a06-4a97-4146-8ebb-31f5effc9c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d97ec4-f806-4bbd-aad8-93fa7c94ba97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d97ec4-f806-4bbd-aad8-93fa7c94ba97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24778fc-474a-45e0-85b1-72cae16452a7', 'volume_name': 'volume-b24778fc-474a-45e0-85b1-72cae16452a7', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b555b509-a2ec-4286-b179-ffd6402dd78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b555b509-a2ec-4286-b179-ffd6402dd78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3808a05d-3926-42ae-b0c0-94af01c79d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:29 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Volume b24778fc-474a-45e0-85b1-72cae16452a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24778fc-474a-45e0-85b1-72cae16452a7', 'volume_size': 1} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1206878653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24778fc-474a-45e0-85b1-72cae16452a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e0c94d4aa14c3b917ab885814e9277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:30Z,use_quota=True,user_id='60be7218b2e94538a8c421c4f94a7b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Creating volume b24778fc-474a-45e0-85b1-72cae16452a7 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:37:30 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:37:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b24778fc-474a-45e0-85b1-72cae16452a7 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:30 devstack sudo[95174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b24778fc-474a-45e0-85b1-72cae16452a7 1073741824 Jul 13 20:37:30 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:30 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b24778fc-474a-45e0-85b1-72cae16452a7 1073741824" returned: 0 in 0.906s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b24778fc-474a-45e0-85b1-72cae16452a7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:31 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b24778fc-474a-45e0-85b1-72cae16452a7 Jul 13 20:37:31 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Flow 'volume_create_manager' (9f68c4be-3628-4455-8a57-53bfc9228b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08960d7f-7418-42ec-8609-5e017f8f4a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08960d7f-7418-42ec-8609-5e017f8f4a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-37713685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3418228-9a53-40f1-82c1-331ccb294b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3a5d3fa6c84059969c9f47aa6bc355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:31Z,use_quota=True,user_id='35b9c20eab024637960b20672b7d93c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a4d377-7eb3-4091-98fc-49551208f2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a4d377-7eb3-4091-98fc-49551208f2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea668235-1eeb-4451-b026-98fae9934138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea668235-1eeb-4451-b026-98fae9934138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3418228-9a53-40f1-82c1-331ccb294b4b', 'volume_name': 'volume-f3418228-9a53-40f1-82c1-331ccb294b4b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8930d5e-6370-416d-a76d-5a79425248ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8930d5e-6370-416d-a76d-5a79425248ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1897e54-5e7e-4714-aa95-24b0e373d2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:31 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Volume f3418228-9a53-40f1-82c1-331ccb294b4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3418228-9a53-40f1-82c1-331ccb294b4b', 'volume_size': 1} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:31 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b24778fc-474a-45e0-85b1-72cae16452a7" returned: 0 in 0.452s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.243s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-37713685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3418228-9a53-40f1-82c1-331ccb294b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3a5d3fa6c84059969c9f47aa6bc355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:31Z,use_quota=True,user_id='35b9c20eab024637960b20672b7d93c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Creating volume f3418228-9a53-40f1-82c1-331ccb294b4b {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:37:31 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f3418228-9a53-40f1-82c1-331ccb294b4b 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3808a05d-3926-42ae-b0c0-94af01c79d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24778fc-474a-45e0-85b1-72cae16452a7', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:31 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f3418228-9a53-40f1-82c1-331ccb294b4b 1073741824 Jul 13 20:37:31 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e278b38-8236-4c13-8252-63838ef55f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:31 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Volume volume-b24778fc-474a-45e0-85b1-72cae16452a7 (b24778fc-474a-45e0-85b1-72cae16452a7): created successfully Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e278b38-8236-4c13-8252-63838ef55f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Flow 'volume_create_manager' (75ec25d2-66dd-44f2-a843-323a126d2d89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:31 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c0ef4279-68bc-4078-87f0-1d2e81f096ff tempest-TestMinimumBasicScenario-251406228 None] Created volume successfully. Jul 13 20:37:32 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f3418228-9a53-40f1-82c1-331ccb294b4b 1073741824" returned: 0 in 0.718s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f3418228-9a53-40f1-82c1-331ccb294b4b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:32 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f3418228-9a53-40f1-82c1-331ccb294b4b Jul 13 20:37:32 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:32 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f3418228-9a53-40f1-82c1-331ccb294b4b" returned: 0 in 0.442s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:37:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1897e54-5e7e-4714-aa95-24b0e373d2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3418228-9a53-40f1-82c1-331ccb294b4b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e5f519-4f86-4d81-967f-ebc9afa54a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:32 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Volume volume-f3418228-9a53-40f1-82c1-331ccb294b4b (f3418228-9a53-40f1-82c1-331ccb294b4b): created successfully Jul 13 20:37:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e5f519-4f86-4d81-967f-ebc9afa54a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Flow 'volume_create_manager' (9f68c4be-3628-4455-8a57-53bfc9228b84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a1b7389e-6443-4aec-99a8-084aad9f2b10 tempest-AttachVolumeTestJSON-290872444 None] Created volume successfully. Jul 13 20:37:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-cf9e1532-4cb1-4a01-af5e-cafa8a5a9cc6 req-9e679aa3-d900-4334-82a2-5b9bcc86ab47 tempest-TestMinimumBasicScenario-251406228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-cf9e1532-4cb1-4a01-af5e-cafa8a5a9cc6 req-9e679aa3-d900-4334-82a2-5b9bcc86ab47 tempest-TestMinimumBasicScenario-251406228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:34 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[931c57c1-6655-4700-867e-51ebb3dbfa5b]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:37:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-cf9e1532-4cb1-4a01-af5e-cafa8a5a9cc6 req-9e679aa3-d900-4334-82a2-5b9bcc86ab47 tempest-TestMinimumBasicScenario-251406228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b24778fc-474a-45e0-85b1-72cae16452a7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:34 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b24778fc-474a-45e0-85b1-72cae16452a7 Jul 13 20:37:34 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:34 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-cf9e1532-4cb1-4a01-af5e-cafa8a5a9cc6 req-9e679aa3-d900-4334-82a2-5b9bcc86ab47 tempest-TestMinimumBasicScenario-251406228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b24778fc-474a-45e0-85b1-72cae16452a7" returned: 0 in 0.621s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-cf9e1532-4cb1-4a01-af5e-cafa8a5a9cc6 req-9e679aa3-d900-4334-82a2-5b9bcc86ab47 tempest-TestMinimumBasicScenario-251406228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.641s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-cf9e1532-4cb1-4a01-af5e-cafa8a5a9cc6 req-9e679aa3-d900-4334-82a2-5b9bcc86ab47 tempest-TestMinimumBasicScenario-251406228 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-b24778fc-474a-45e0-85b1-72cae16452a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c558d6f-96dd-413e-9f5f-61db5f37c8e7', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:37:34 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-cf9e1532-4cb1-4a01-af5e-cafa8a5a9cc6 req-9e679aa3-d900-4334-82a2-5b9bcc86ab47 tempest-TestMinimumBasicScenario-251406228 None] attachment_update completed successfully. Jul 13 20:37:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a4ff5a1a-db6f-4a59-ba0e-930c3c646cf1 req-7f4b8ab1-36ea-467e-9ccf-28f9e5ab3f89 tempest-AttachVolumeTestJSON-290872444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a4ff5a1a-db6f-4a59-ba0e-930c3c646cf1 req-7f4b8ab1-36ea-467e-9ccf-28f9e5ab3f89 tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:35 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10cf6b2-c0ff-4a90-8132-ebab62e9da2b]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:37:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-a4ff5a1a-db6f-4a59-ba0e-930c3c646cf1 req-7f4b8ab1-36ea-467e-9ccf-28f9e5ab3f89 tempest-AttachVolumeTestJSON-290872444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f3418228-9a53-40f1-82c1-331ccb294b4b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:35 devstack sudo[95252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f3418228-9a53-40f1-82c1-331ccb294b4b Jul 13 20:37:35 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:35 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-a4ff5a1a-db6f-4a59-ba0e-930c3c646cf1 req-7f4b8ab1-36ea-467e-9ccf-28f9e5ab3f89 tempest-AttachVolumeTestJSON-290872444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f3418228-9a53-40f1-82c1-331ccb294b4b" returned: 0 in 0.584s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a4ff5a1a-db6f-4a59-ba0e-930c3c646cf1 req-7f4b8ab1-36ea-467e-9ccf-28f9e5ab3f89 tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.614s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a4ff5a1a-db6f-4a59-ba0e-930c3c646cf1 req-7f4b8ab1-36ea-467e-9ccf-28f9e5ab3f89 tempest-AttachVolumeTestJSON-290872444 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-f3418228-9a53-40f1-82c1-331ccb294b4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed9becbe-fc58-42eb-b1db-ffaff71d447a', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:37:35 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-a4ff5a1a-db6f-4a59-ba0e-930c3c646cf1 req-7f4b8ab1-36ea-467e-9ccf-28f9e5ab3f89 tempest-AttachVolumeTestJSON-290872444 None] attachment_update completed successfully. Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Flow 'volume_create_manager' (9c04f965-a97a-41b5-80fd-ca6b69aa429c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31a529a-3931-47c7-9af2-54bdd1628be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31a529a-3931-47c7-9af2-54bdd1628be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1613565377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e58bf38-880c-4752-a505-e7281fb71350,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2d9f11dd08743639d7166bf35a5e42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:38Z,use_quota=True,user_id='64389794670140d2aef669d11c1a3e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0703e7-d50d-444f-9498-6c3ba3e50339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0703e7-d50d-444f-9498-6c3ba3e50339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15d20f5-3c96-47ea-b6a7-82b11e6e0ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15d20f5-3c96-47ea-b6a7-82b11e6e0ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e58bf38-880c-4752-a505-e7281fb71350', 'volume_name': 'volume-8e58bf38-880c-4752-a505-e7281fb71350', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ee9328-4d9b-48d5-bfb8-65200b6443b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ee9328-4d9b-48d5-bfb8-65200b6443b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad68472-aaec-440e-9993-8a424542b02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:38 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Volume 8e58bf38-880c-4752-a505-e7281fb71350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e58bf38-880c-4752-a505-e7281fb71350', 'volume_size': 1} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1613565377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e58bf38-880c-4752-a505-e7281fb71350,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2d9f11dd08743639d7166bf35a5e42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:38Z,use_quota=True,user_id='64389794670140d2aef669d11c1a3e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Creating volume 8e58bf38-880c-4752-a505-e7281fb71350 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:37:38 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:37:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8e58bf38-880c-4752-a505-e7281fb71350 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:38 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8e58bf38-880c-4752-a505-e7281fb71350 1073741824 Jul 13 20:37:38 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:39 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8e58bf38-880c-4752-a505-e7281fb71350 1073741824" returned: 0 in 0.844s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8e58bf38-880c-4752-a505-e7281fb71350 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:39 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8e58bf38-880c-4752-a505-e7281fb71350 Jul 13 20:37:39 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:39 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8e58bf38-880c-4752-a505-e7281fb71350" returned: 0 in 0.292s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:37:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad68472-aaec-440e-9993-8a424542b02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e58bf38-880c-4752-a505-e7281fb71350', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298d1a92-8a31-431b-bddd-6a2c1361dd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:39 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Volume volume-8e58bf38-880c-4752-a505-e7281fb71350 (8e58bf38-880c-4752-a505-e7281fb71350): created successfully Jul 13 20:37:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298d1a92-8a31-431b-bddd-6a2c1361dd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Flow 'volume_create_manager' (9c04f965-a97a-41b5-80fd-ca6b69aa429c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f03accbc-8f52-4409-83fe-636e041fdfea tempest-VolumesListTestJSON-387984642 None] Created volume successfully. Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Flow 'volume_create_manager' (b2049164-38cb-4a03-890b-ebae996f2b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a4a210-9dd8-4353-97fa-232d99c41473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a4a210-9dd8-4353-97fa-232d99c41473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-101027437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bd0894-b912-405f-a61f-fcc1a3597347,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2d9f11dd08743639d7166bf35a5e42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:41Z,use_quota=True,user_id='64389794670140d2aef669d11c1a3e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae4e61a-bda9-43d2-8213-27088361c3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae4e61a-bda9-43d2-8213-27088361c3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab53010-2657-412c-a5a2-13e3b30e2adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab53010-2657-412c-a5a2-13e3b30e2adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16bd0894-b912-405f-a61f-fcc1a3597347', 'volume_name': 'volume-16bd0894-b912-405f-a61f-fcc1a3597347', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (375e854f-7680-4222-b3c1-90af50d1f2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (375e854f-7680-4222-b3c1-90af50d1f2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b23d25-9e15-4790-8bf0-cc794a7025c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:41 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Volume 16bd0894-b912-405f-a61f-fcc1a3597347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16bd0894-b912-405f-a61f-fcc1a3597347', 'volume_size': 1} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-101027437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bd0894-b912-405f-a61f-fcc1a3597347,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2d9f11dd08743639d7166bf35a5e42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:41Z,use_quota=True,user_id='64389794670140d2aef669d11c1a3e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Creating volume 16bd0894-b912-405f-a61f-fcc1a3597347 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:37:41 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-16bd0894-b912-405f-a61f-fcc1a3597347 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:41 devstack sudo[95648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-16bd0894-b912-405f-a61f-fcc1a3597347 1073741824 Jul 13 20:37:41 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:41 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-16bd0894-b912-405f-a61f-fcc1a3597347 1073741824" returned: 0 in 0.603s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-16bd0894-b912-405f-a61f-fcc1a3597347 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:41 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-16bd0894-b912-405f-a61f-fcc1a3597347 Jul 13 20:37:41 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:42 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-16bd0894-b912-405f-a61f-fcc1a3597347" returned: 0 in 0.356s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:37:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b23d25-9e15-4790-8bf0-cc794a7025c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16bd0894-b912-405f-a61f-fcc1a3597347', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c77bd8-cec3-45cf-8d1e-0d35253c063c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:42 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Volume volume-16bd0894-b912-405f-a61f-fcc1a3597347 (16bd0894-b912-405f-a61f-fcc1a3597347): created successfully Jul 13 20:37:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c77bd8-cec3-45cf-8d1e-0d35253c063c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Flow 'volume_create_manager' (b2049164-38cb-4a03-890b-ebae996f2b26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:42 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-87a06d2e-e1cb-4484-aa55-541de55fc4dc tempest-VolumesListTestJSON-387984642 None] Created volume successfully. Jul 13 20:37:43 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Flow 'volume_create_manager' (0a77d85a-ea9a-4c98-80cb-ece733e13b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27df0be2-fde2-4b99-a56c-144245e1c671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27df0be2-fde2-4b99-a56c-144245e1c671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1977391640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b2a99d-79c1-4a09-83c2-66d810ba8b5b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2d9f11dd08743639d7166bf35a5e42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:44Z,use_quota=True,user_id='64389794670140d2aef669d11c1a3e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45b9716-e6ea-425b-ad37-e78d8d3855f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45b9716-e6ea-425b-ad37-e78d8d3855f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae7ebdd-c42e-477a-8087-6481858df89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae7ebdd-c42e-477a-8087-6481858df89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41b2a99d-79c1-4a09-83c2-66d810ba8b5b', 'volume_name': 'volume-41b2a99d-79c1-4a09-83c2-66d810ba8b5b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79a8db8-2a2a-45c1-bd54-c0d27736cb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79a8db8-2a2a-45c1-bd54-c0d27736cb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3e862f-cc4a-41e3-9adb-944a32c91f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:44 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Volume 41b2a99d-79c1-4a09-83c2-66d810ba8b5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41b2a99d-79c1-4a09-83c2-66d810ba8b5b', 'volume_size': 1} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1977391640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b2a99d-79c1-4a09-83c2-66d810ba8b5b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2d9f11dd08743639d7166bf35a5e42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:37:44Z,use_quota=True,user_id='64389794670140d2aef669d11c1a3e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Creating volume 41b2a99d-79c1-4a09-83c2-66d810ba8b5b {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:37:44 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41b2a99d-79c1-4a09-83c2-66d810ba8b5b 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:44 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41b2a99d-79c1-4a09-83c2-66d810ba8b5b 1073741824 Jul 13 20:37:44 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:44 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41b2a99d-79c1-4a09-83c2-66d810ba8b5b 1073741824" returned: 0 in 0.563s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41b2a99d-79c1-4a09-83c2-66d810ba8b5b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:44 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41b2a99d-79c1-4a09-83c2-66d810ba8b5b Jul 13 20:37:44 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:45 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41b2a99d-79c1-4a09-83c2-66d810ba8b5b" returned: 0 in 0.302s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:37:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3e862f-cc4a-41e3-9adb-944a32c91f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41b2a99d-79c1-4a09-83c2-66d810ba8b5b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c409cf63-863b-4f0e-a8a6-8b02d382f7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:37:45 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Volume volume-41b2a99d-79c1-4a09-83c2-66d810ba8b5b (41b2a99d-79c1-4a09-83c2-66d810ba8b5b): created successfully Jul 13 20:37:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c409cf63-863b-4f0e-a8a6-8b02d382f7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:37:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Flow 'volume_create_manager' (0a77d85a-ea9a-4c98-80cb-ece733e13b1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:37:45 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8b5265f0-128f-404c-977a-8441bbd0067b tempest-VolumesListTestJSON-387984642 None] Created volume successfully. Jul 13 20:37:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] Acquiring lock "cinder-41b2a99d-79c1-4a09-83c2-66d810ba8b5b-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] Lock "cinder-41b2a99d-79c1-4a09-83c2-66d810ba8b5b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] Acquiring lock "cinder-quobyte-41b2a99d-79c1-4a09-83c2-66d810ba8b5b" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] Lock "cinder-quobyte-41b2a99d-79c1-4a09-83c2-66d810ba8b5b" acquired by "delete_volume" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:50 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[842e54c6-fc70-491b-8e70-b5c5d394a74c]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:37:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41b2a99d-79c1-4a09-83c2-66d810ba8b5b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:50 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41b2a99d-79c1-4a09-83c2-66d810ba8b5b Jul 13 20:37:50 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:50 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41b2a99d-79c1-4a09-83c2-66d810ba8b5b" returned: 0 in 0.734s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41b2a99d-79c1-4a09-83c2-66d810ba8b5b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:50 devstack sudo[95820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41b2a99d-79c1-4a09-83c2-66d810ba8b5b Jul 13 20:37:50 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:51 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41b2a99d-79c1-4a09-83c2-66d810ba8b5b" returned: 0 in 0.462s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] Lock "cinder-quobyte-41b2a99d-79c1-4a09-83c2-66d810ba8b5b" released by "delete_volume" :: held 1.283s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:37:51 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] Created reservations ['65b6e437-b343-4dc2-a2b8-5f44b71b666d', '74c9a142-aea5-4c37-b267-003b48254028', 'cc5d9e05-8e15-4e9f-b6d3-e43282d7948d', 'be8d2cf5-b809-4941-a669-b8e88dd5c861'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:37:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:51 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:37:51 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:52 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.565s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:52 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:37:52 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] Deleted volume successfully. Jul 13 20:37:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d939def3-c6fd-4806-9683-f12beeeebbd6 tempest-VolumesListTestJSON-387984642 None] Lock "cinder-41b2a99d-79c1-4a09-83c2-66d810ba8b5b-delete_volume" released by "delete_volume" :: held 2.464s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:37:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] Acquiring lock "cinder-16bd0894-b912-405f-a61f-fcc1a3597347-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] Lock "cinder-16bd0894-b912-405f-a61f-fcc1a3597347-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] Acquiring lock "cinder-quobyte-16bd0894-b912-405f-a61f-fcc1a3597347" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] Lock "cinder-quobyte-16bd0894-b912-405f-a61f-fcc1a3597347" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:52 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f865a4-5c47-4c71-8973-923971ffbdfa]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:37:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-16bd0894-b912-405f-a61f-fcc1a3597347 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:52 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-16bd0894-b912-405f-a61f-fcc1a3597347 Jul 13 20:37:52 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:53 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-16bd0894-b912-405f-a61f-fcc1a3597347" returned: 0 in 0.784s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-16bd0894-b912-405f-a61f-fcc1a3597347 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:53 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-16bd0894-b912-405f-a61f-fcc1a3597347 Jul 13 20:37:53 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:53 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-16bd0894-b912-405f-a61f-fcc1a3597347" returned: 0 in 0.441s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] Lock "cinder-quobyte-16bd0894-b912-405f-a61f-fcc1a3597347" released by "delete_volume" :: held 1.313s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:37:54 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] Created reservations ['95cce26e-5dcf-4164-a5ad-421d63827e11', 'e30f6b1f-a10b-428e-8527-f0a46730334f', 'd3660116-81d8-460d-bf43-d0384ff1eacf', '4210389e-63a4-4a8f-bdbf-3153856bce2f'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:37:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:54 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:37:54 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:54 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.356s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:54 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:37:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] Deleted volume successfully. Jul 13 20:37:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2ef11f5-fb89-410c-9221-2df5291b16b9 tempest-VolumesListTestJSON-387984642 None] Lock "cinder-16bd0894-b912-405f-a61f-fcc1a3597347-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:37:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] Acquiring lock "cinder-8e58bf38-880c-4752-a505-e7281fb71350-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] Lock "cinder-8e58bf38-880c-4752-a505-e7281fb71350-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] Acquiring lock "cinder-quobyte-8e58bf38-880c-4752-a505-e7281fb71350" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:37:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] Lock "cinder-quobyte-8e58bf38-880c-4752-a505-e7281fb71350" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:37:55 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb62fad-47de-4d4c-8454-4ca6b1a6f51c]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:37:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8e58bf38-880c-4752-a505-e7281fb71350 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:55 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8e58bf38-880c-4752-a505-e7281fb71350 Jul 13 20:37:55 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:55 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8e58bf38-880c-4752-a505-e7281fb71350" returned: 0 in 0.529s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8e58bf38-880c-4752-a505-e7281fb71350 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:55 devstack sudo[95882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8e58bf38-880c-4752-a505-e7281fb71350 Jul 13 20:37:55 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:56 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8e58bf38-880c-4752-a505-e7281fb71350" returned: 0 in 0.433s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] Lock "cinder-quobyte-8e58bf38-880c-4752-a505-e7281fb71350" released by "delete_volume" :: held 1.041s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:37:56 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=115,cinder:DELETE=14,cinder:SELECT=77,cinder:INSERT=26 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:37:56 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] Created reservations ['e36aceac-c674-4a79-9a3e-104bc70b8e44', '9bdaf7fd-ae9a-405e-800c-7c11a6c57504', '085c1710-714a-4a31-b4a5-66d93a9a7162', '43ebc4fb-60b8-41ca-a94c-611429dec540'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:37:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:37:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:37:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:37:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:37:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:37:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:37:56 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:37:56 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:37:57 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Jul 13 20:37:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.502s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:37:57 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:37:57 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] Deleted volume successfully. Jul 13 20:37:57 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=113,cinder:SELECT=102,cinder:INSERT=36,cinder:DELETE=7 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:37:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9dbb943d-8f24-4a27-99f8-34f1e766bd66 tempest-VolumesListTestJSON-387984642 None] Lock "cinder-8e58bf38-880c-4752-a505-e7281fb71350-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:02 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:38:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Flow 'volume_create_manager' (7784d502-73b0-496f-a1f5-4be570cadbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:38:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de82d84-5afa-4ecf-9706-483069a7caaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de82d84-5afa-4ecf-9706-483069a7caaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1053568769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7122e987-101e-420e-a0a6-3435463f97cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0011da330c140e692f9cabda0d625e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:38:03Z,use_quota=True,user_id='069ef013a1cd410998493a6b6bf5890a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e720251e-db26-405b-a43a-e2ecd935455d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e720251e-db26-405b-a43a-e2ecd935455d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a9e832-a339-4763-8bff-5449f4a022c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a9e832-a339-4763-8bff-5449f4a022c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7122e987-101e-420e-a0a6-3435463f97cb', 'volume_name': 'volume-7122e987-101e-420e-a0a6-3435463f97cb', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8bc61a7-7345-4160-9764-5ab4044a8004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8bc61a7-7345-4160-9764-5ab4044a8004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88c1152-2e22-4820-a111-dbf827ade102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:02 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Volume 7122e987-101e-420e-a0a6-3435463f97cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7122e987-101e-420e-a0a6-3435463f97cb', 'volume_size': 1} Jul 13 20:38:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1053568769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7122e987-101e-420e-a0a6-3435463f97cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0011da330c140e692f9cabda0d625e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:38:03Z,use_quota=True,user_id='069ef013a1cd410998493a6b6bf5890a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:38:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Creating volume 7122e987-101e-420e-a0a6-3435463f97cb {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:38:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:38:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:38:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:38:03 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:38:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:03 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb 1073741824 Jul 13 20:38:03 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:03 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb 1073741824" returned: 0 in 0.590s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:03 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb Jul 13 20:38:03 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:03 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb" returned: 0 in 0.296s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:38:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88c1152-2e22-4820-a111-dbf827ade102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7122e987-101e-420e-a0a6-3435463f97cb', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75659a7f-856f-4363-8c78-3b52ec10aeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:03 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Volume volume-7122e987-101e-420e-a0a6-3435463f97cb (7122e987-101e-420e-a0a6-3435463f97cb): created successfully Jul 13 20:38:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75659a7f-856f-4363-8c78-3b52ec10aeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Flow 'volume_create_manager' (7784d502-73b0-496f-a1f5-4be570cadbbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:38:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-383b029e-99b1-458a-b8b4-e7b2d505458f tempest-VolumesSnapshotListTestJSON-1258850121 None] Created volume successfully. Jul 13 20:38:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8f92d5a6-73df-4562-9380-36c480d1f6cd tempest-VolumesSnapshotListTestJSON-1258850121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8f92d5a6-73df-4562-9380-36c480d1f6cd tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8f92d5a6-73df-4562-9380-36c480d1f6cd tempest-VolumesSnapshotListTestJSON-1258850121 None] Creating offline snapshot 7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 of volume 7122e987-101e-420e-a0a6-3435463f97cb {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:38:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a613c63e-6060-477a-8fd5-9f1b48e0de4d]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:38:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8f92d5a6-73df-4562-9380-36c480d1f6cd tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:05 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb Jul 13 20:38:05 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:05 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8f92d5a6-73df-4562-9380-36c480d1f6cd tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb" returned: 0 in 0.483s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8f92d5a6-73df-4562-9380-36c480d1f6cd tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:05 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 1G Jul 13 20:38:05 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:06 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8f92d5a6-73df-4562-9380-36c480d1f6cd tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 1G" returned: 0 in 0.533s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8f92d5a6-73df-4562-9380-36c480d1f6cd tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7122e987-101e-420e-a0a6-3435463f97cb -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:06 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7122e987-101e-420e-a0a6-3435463f97cb -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 Jul 13 20:38:06 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:06 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8f92d5a6-73df-4562-9380-36c480d1f6cd tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7122e987-101e-420e-a0a6-3435463f97cb -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0" returned: 0 in 0.376s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:06 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-8f92d5a6-73df-4562-9380-36c480d1f6cd tempest-VolumesSnapshotListTestJSON-1258850121 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 is being set with open permissions: ugo+rw Jul 13 20:38:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8f92d5a6-73df-4562-9380-36c480d1f6cd tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:06 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 Jul 13 20:38:06 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:07 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8f92d5a6-73df-4562-9380-36c480d1f6cd tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0" returned: 0 in 0.244s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8f92d5a6-73df-4562-9380-36c480d1f6cd tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:07 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.info Jul 13 20:38:07 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:07 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8f92d5a6-73df-4562-9380-36c480d1f6cd tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.info" returned: 0 in 0.271s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:07 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-8f92d5a6-73df-4562-9380-36c480d1f6cd tempest-VolumesSnapshotListTestJSON-1258850121 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.info is being set with open permissions: ugo+rw Jul 13 20:38:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8f92d5a6-73df-4562-9380-36c480d1f6cd tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:07 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.info Jul 13 20:38:07 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:07 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8f92d5a6-73df-4562-9380-36c480d1f6cd tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.info" returned: 0 in 0.264s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8f92d5a6-73df-4562-9380-36c480d1f6cd tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.273s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8f92d5a6-73df-4562-9380-36c480d1f6cd tempest-VolumesSnapshotListTestJSON-1258850121 None] Create snapshot completed successfully Jul 13 20:38:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a3bfbbd1-8f81-4247-801a-efc1c98ed404 tempest-VolumesSnapshotListTestJSON-1258850121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a3bfbbd1-8f81-4247-801a-efc1c98ed404 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a3bfbbd1-8f81-4247-801a-efc1c98ed404 tempest-VolumesSnapshotListTestJSON-1258850121 None] Creating offline snapshot 74cb234f-d510-458e-af46-51b2d13f2aa0 of volume 7122e987-101e-420e-a0a6-3435463f97cb {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:38:09 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0c957d-dfec-4a79-bba3-10fae96b33d3]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:38:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a3bfbbd1-8f81-4247-801a-efc1c98ed404 tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:09 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 Jul 13 20:38:09 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:09 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a3bfbbd1-8f81-4247-801a-efc1c98ed404 tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0" returned: 0 in 0.768s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a3bfbbd1-8f81-4247-801a-efc1c98ed404 tempest-VolumesSnapshotListTestJSON-1258850121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7122e987-101e-420e-a0a6-3435463f97cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:38:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a3bfbbd1-8f81-4247-801a-efc1c98ed404 tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:09 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 1G Jul 13 20:38:09 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:10 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a3bfbbd1-8f81-4247-801a-efc1c98ed404 tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 1G" returned: 0 in 0.726s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a3bfbbd1-8f81-4247-801a-efc1c98ed404 tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:10 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 Jul 13 20:38:10 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:11 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a3bfbbd1-8f81-4247-801a-efc1c98ed404 tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0" returned: 0 in 0.764s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:11 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-a3bfbbd1-8f81-4247-801a-efc1c98ed404 tempest-VolumesSnapshotListTestJSON-1258850121 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 is being set with open permissions: ugo+rw Jul 13 20:38:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a3bfbbd1-8f81-4247-801a-efc1c98ed404 tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:11 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 Jul 13 20:38:11 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:11 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a3bfbbd1-8f81-4247-801a-efc1c98ed404 tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0" returned: 0 in 0.573s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a3bfbbd1-8f81-4247-801a-efc1c98ed404 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.071s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a3bfbbd1-8f81-4247-801a-efc1c98ed404 tempest-VolumesSnapshotListTestJSON-1258850121 None] Create snapshot completed successfully Jul 13 20:38:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-42e87cae-c9dc-4f40-9ac4-cbce2d78cf48 tempest-VolumesSnapshotListTestJSON-1258850121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-42e87cae-c9dc-4f40-9ac4-cbce2d78cf48 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-42e87cae-c9dc-4f40-9ac4-cbce2d78cf48 tempest-VolumesSnapshotListTestJSON-1258850121 None] Creating offline snapshot 689c57d5-9682-4cf0-baa6-04fad08ffb65 of volume 7122e987-101e-420e-a0a6-3435463f97cb {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:38:12 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[49388edc-a741-46cc-beb3-5bac182d2925]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:38:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-42e87cae-c9dc-4f40-9ac4-cbce2d78cf48 tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:12 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:38:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Flow 'volume_create_manager' (9607cb15-1310-44aa-be47-ecdf205977bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:38:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd823675-97d2-48b8-9184-56d978c156cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd823675-97d2-48b8-9184-56d978c156cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-908718873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41382fc9-9431-4ecb-9427-34e1aa8e718c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9f76ab22b04144a4d17c8e631e4461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:38:13Z,use_quota=True,user_id='73d8dbf0e71b4d5baec8070b3fe04ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a125537-3907-4b03-a4b9-f1645f8652f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a125537-3907-4b03-a4b9-f1645f8652f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15355645-31cb-44f1-8d99-429a35b91f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15355645-31cb-44f1-8d99-429a35b91f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41382fc9-9431-4ecb-9427-34e1aa8e718c', 'volume_name': 'volume-41382fc9-9431-4ecb-9427-34e1aa8e718c', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c556f4e2-cd07-4781-8e21-7cb452decaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c556f4e2-cd07-4781-8e21-7cb452decaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b579898-e7bb-4388-a1ad-6afc9d337283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:13 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Volume 41382fc9-9431-4ecb-9427-34e1aa8e718c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41382fc9-9431-4ecb-9427-34e1aa8e718c', 'volume_size': 1} Jul 13 20:38:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:13 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 Jul 13 20:38:13 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:13 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-42e87cae-c9dc-4f40-9ac4-cbce2d78cf48 tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0" returned: 0 in 0.490s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-42e87cae-c9dc-4f40-9ac4-cbce2d78cf48 tempest-VolumesSnapshotListTestJSON-1258850121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7122e987-101e-420e-a0a6-3435463f97cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:38:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-42e87cae-c9dc-4f40-9ac4-cbce2d78cf48 tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:13 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65 1G Jul 13 20:38:13 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:13 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-42e87cae-c9dc-4f40-9ac4-cbce2d78cf48 tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65 1G" returned: 0 in 0.549s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-42e87cae-c9dc-4f40-9ac4-cbce2d78cf48 tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:13 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65 Jul 13 20:38:13 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:14 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-42e87cae-c9dc-4f40-9ac4-cbce2d78cf48 tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65" returned: 0 in 0.313s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:14 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-42e87cae-c9dc-4f40-9ac4-cbce2d78cf48 tempest-VolumesSnapshotListTestJSON-1258850121 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65 is being set with open permissions: ugo+rw Jul 13 20:38:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-42e87cae-c9dc-4f40-9ac4-cbce2d78cf48 tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:14 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65 Jul 13 20:38:14 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:14 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-42e87cae-c9dc-4f40-9ac4-cbce2d78cf48 tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65" returned: 0 in 0.282s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-42e87cae-c9dc-4f40-9ac4-cbce2d78cf48 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.808s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.549s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-908718873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41382fc9-9431-4ecb-9427-34e1aa8e718c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9f76ab22b04144a4d17c8e631e4461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:38:13Z,use_quota=True,user_id='73d8dbf0e71b4d5baec8070b3fe04ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:38:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Creating volume 41382fc9-9431-4ecb-9427-34e1aa8e718c {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:38:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:38:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:38:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:38:14 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:38:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41382fc9-9431-4ecb-9427-34e1aa8e718c 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:14 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41382fc9-9431-4ecb-9427-34e1aa8e718c 1073741824 Jul 13 20:38:14 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-42e87cae-c9dc-4f40-9ac4-cbce2d78cf48 tempest-VolumesSnapshotListTestJSON-1258850121 None] Create snapshot completed successfully Jul 13 20:38:15 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41382fc9-9431-4ecb-9427-34e1aa8e718c 1073741824" returned: 0 in 0.530s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41382fc9-9431-4ecb-9427-34e1aa8e718c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:15 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41382fc9-9431-4ecb-9427-34e1aa8e718c Jul 13 20:38:15 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:15 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41382fc9-9431-4ecb-9427-34e1aa8e718c" returned: 0 in 0.430s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:38:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b579898-e7bb-4388-a1ad-6afc9d337283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41382fc9-9431-4ecb-9427-34e1aa8e718c', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81bbc567-2955-4012-a12a-5395069c028f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:15 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Volume volume-41382fc9-9431-4ecb-9427-34e1aa8e718c (41382fc9-9431-4ecb-9427-34e1aa8e718c): created successfully Jul 13 20:38:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81bbc567-2955-4012-a12a-5395069c028f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Flow 'volume_create_manager' (9607cb15-1310-44aa-be47-ecdf205977bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:38:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6a69d83d-1c58-46ec-8720-9a9826c4655c tempest-VolumesActionsTest-1859263553 None] Created volume successfully. Jul 13 20:38:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-917835ee-d549-44e5-9919-c23f9272324a tempest-VolumesActionsTest-1859263553 None] Acquiring lock "cinder-41382fc9-9431-4ecb-9427-34e1aa8e718c" by "attach_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-917835ee-d549-44e5-9919-c23f9272324a tempest-VolumesActionsTest-1859263553 None] Lock "cinder-41382fc9-9431-4ecb-9427-34e1aa8e718c" acquired by "attach_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-f5a977a0-d522-49e9-a254-06cc923d0838 req-040727bd-7ab0-4476-9bb9-6d6f888971a7 tempest-AttachVolumeTestJSON-290872444 None] Terminate volume connection completed successfully. Jul 13 20:38:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-f5a977a0-d522-49e9-a254-06cc923d0838 req-040727bd-7ab0-4476-9bb9-6d6f888971a7 tempest-AttachVolumeTestJSON-290872444 None] Deleting attachment ed9becbe-fc58-42eb-b1db-ffaff71d447a. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:38:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-917835ee-d549-44e5-9919-c23f9272324a tempest-VolumesActionsTest-1859263553 None] Attaching volume 41382fc9-9431-4ecb-9427-34e1aa8e718c to instance 46d3f899-35e8-49aa-9b6f-c13f78b28330 at mountpoint /dev/vdb on host None. Jul 13 20:38:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-917835ee-d549-44e5-9919-c23f9272324a tempest-VolumesActionsTest-1859263553 None] Attach volume completed successfully. Jul 13 20:38:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-917835ee-d549-44e5-9919-c23f9272324a tempest-VolumesActionsTest-1859263553 None] Lock "cinder-41382fc9-9431-4ecb-9427-34e1aa8e718c" released by "attach_volume" :: held 0.133s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-52eb1570-eb42-4ca5-95a0-3d7b988f9d82 tempest-VolumesActionsTest-1071384797 None] Terminate volume connection completed successfully. Jul 13 20:38:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-52eb1570-eb42-4ca5-95a0-3d7b988f9d82 tempest-VolumesActionsTest-1071384797 None] Acquiring lock "cinder-41382fc9-9431-4ecb-9427-34e1aa8e718c-detach_volume" by "detach_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-52eb1570-eb42-4ca5-95a0-3d7b988f9d82 tempest-VolumesActionsTest-1071384797 None] Lock "cinder-41382fc9-9431-4ecb-9427-34e1aa8e718c-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-52eb1570-eb42-4ca5-95a0-3d7b988f9d82 tempest-VolumesActionsTest-1071384797 None] Detaching volume 41382fc9-9431-4ecb-9427-34e1aa8e718c from instance 46d3f899-35e8-49aa-9b6f-c13f78b28330. Jul 13 20:38:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-52eb1570-eb42-4ca5-95a0-3d7b988f9d82 tempest-VolumesActionsTest-1071384797 None] Detach volume completed successfully. Jul 13 20:38:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-52eb1570-eb42-4ca5-95a0-3d7b988f9d82 tempest-VolumesActionsTest-1071384797 None] Lock "cinder-41382fc9-9431-4ecb-9427-34e1aa8e718c-detach_volume" released by "detach_volume" :: held 0.091s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] Acquiring lock "cinder-689c57d5-9682-4cf0-baa6-04fad08ffb65-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0757e1cc-baad-4f48-94ea-431994049930 tempest-VolumesActionsTest-1859263553 None] Acquiring lock "cinder-41382fc9-9431-4ecb-9427-34e1aa8e718c-detach_volume" by "detach_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-689c57d5-9682-4cf0-baa6-04fad08ffb65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] Acquiring lock "cinder-quobyte-7122e987-101e-420e-a0a6-3435463f97cb" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0757e1cc-baad-4f48-94ea-431994049930 tempest-VolumesActionsTest-1859263553 None] Lock "cinder-41382fc9-9431-4ecb-9427-34e1aa8e718c-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0757e1cc-baad-4f48-94ea-431994049930 tempest-VolumesActionsTest-1859263553 None] Volume detach called, but volume not attached. Jul 13 20:38:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-quobyte-7122e987-101e-420e-a0a6-3435463f97cb" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] Acquiring lock "cinder-quobyte-689c57d5-9682-4cf0-baa6-04fad08ffb65" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0757e1cc-baad-4f48-94ea-431994049930 tempest-VolumesActionsTest-1859263553 None] Lock "cinder-41382fc9-9431-4ecb-9427-34e1aa8e718c-detach_volume" released by "detach_volume" :: held 0.048s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-quobyte-689c57d5-9682-4cf0-baa6-04fad08ffb65" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] Deleting offline snapshot 689c57d5-9682-4cf0-baa6-04fad08ffb65 of volume 7122e987-101e-420e-a0a6-3435463f97cb {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:38:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] snapshot_file for this snap is: volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:38:17 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef78638-a718-4942-a4cd-84ec81f7e7b4]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:38:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:17 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65 Jul 13 20:38:17 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] Acquiring lock "cinder-41382fc9-9431-4ecb-9427-34e1aa8e718c-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] Lock "cinder-41382fc9-9431-4ecb-9427-34e1aa8e718c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] Acquiring lock "cinder-quobyte-41382fc9-9431-4ecb-9427-34e1aa8e718c" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] Lock "cinder-quobyte-41382fc9-9431-4ecb-9427-34e1aa8e718c" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9fea7d-9a59-4ff6-a728-270958835a32]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41382fc9-9431-4ecb-9427-34e1aa8e718c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:18 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65" returned: 0 in 0.520s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7122e987-101e-420e-a0a6-3435463f97cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[29eba83f-7541-4c5b-ae88-90ab9daedce5]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:18 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41382fc9-9431-4ecb-9427-34e1aa8e718c Jul 13 20:38:18 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:18 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 Jul 13 20:38:18 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:18 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41382fc9-9431-4ecb-9427-34e1aa8e718c" returned: 0 in 0.423s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41382fc9-9431-4ecb-9427-34e1aa8e718c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:18 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41382fc9-9431-4ecb-9427-34e1aa8e718c Jul 13 20:38:18 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:18 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0" returned: 0 in 0.573s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7122e987-101e-420e-a0a6-3435463f97cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:18 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:38:18 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:18 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65 Jul 13 20:38:18 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:18 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-41382fc9-9431-4ecb-9427-34e1aa8e718c" returned: 0 in 0.315s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] Lock "cinder-quobyte-41382fc9-9431-4ecb-9427-34e1aa8e718c" released by "delete_volume" :: held 0.794s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:19 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] Created reservations ['9fc8c42f-f041-4a43-9868-5943a1b03cb3', '3e478471-6a56-48e9-a105-87e2d05b8793', '448a8168-ddd1-457b-82e8-24d034b1a51b', 'a51a41c3-c0b3-492f-91b8-cb4cf12333de'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:38:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:38:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:38:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:19 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:38:19 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:19 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.738s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:38:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:38:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:38:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:38:19 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.634s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:38:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] Deleted volume successfully. Jul 13 20:38:19 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65" returned: 0 in 1.091s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:20 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65 Jul 13 20:38:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ad162198-0658-4720-ac7b-b41c5a7cfa1e tempest-VolumesActionsTest-1859263553 None] Lock "cinder-41382fc9-9431-4ecb-9427-34e1aa8e718c-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:20 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:20 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.689c57d5-9682-4cf0-baa6-04fad08ffb65" returned: 0 in 0.626s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-quobyte-689c57d5-9682-4cf0-baa6-04fad08ffb65" released by "_delete_snapshot" :: held 2.978s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-quobyte-7122e987-101e-420e-a0a6-3435463f97cb" released by "delete_snapshot" :: held 3.036s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:20 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] Created reservations ['c0c9f6f4-afc0-4ed4-a882-59be8681d09d', '4236d923-153b-4b4b-80fd-2bbd28ed9d5e', '7fe8deac-dc72-4b6a-a7c2-c8a99b56bb9f', 'abb2c996-bd71-4015-9823-79c039a8ebb1'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:38:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] Delete snapshot completed successfully. Jul 13 20:38:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-80438507-3451-4d14-95b9-ea502c85c98f tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-689c57d5-9682-4cf0-baa6-04fad08ffb65-delete_snapshot" released by "delete_snapshot" :: held 3.387s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] Acquiring lock "cinder-74cb234f-d510-458e-af46-51b2d13f2aa0-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-74cb234f-d510-458e-af46-51b2d13f2aa0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] Acquiring lock "cinder-quobyte-7122e987-101e-420e-a0a6-3435463f97cb" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-quobyte-7122e987-101e-420e-a0a6-3435463f97cb" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] Acquiring lock "cinder-quobyte-74cb234f-d510-458e-af46-51b2d13f2aa0" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-quobyte-74cb234f-d510-458e-af46-51b2d13f2aa0" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] Deleting offline snapshot 74cb234f-d510-458e-af46-51b2d13f2aa0 of volume 7122e987-101e-420e-a0a6-3435463f97cb {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:38:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] snapshot_file for this snap is: volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:38:22 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ebf85e-1c1a-4fc5-8078-0c8d5ade9d38]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:38:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:22 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 Jul 13 20:38:22 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:22 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0" returned: 0 in 0.716s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7122e987-101e-420e-a0a6-3435463f97cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:38:22 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c33083c-043b-4b0b-9e6a-6c49e6e55282]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:38:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:23 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 Jul 13 20:38:23 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:24 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0" returned: 0 in 1.056s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7122e987-101e-420e-a0a6-3435463f97cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:38:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:24 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 Jul 13 20:38:24 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:24 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0" returned: 0 in 0.690s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:24 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0 Jul 13 20:38:24 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:25 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.74cb234f-d510-458e-af46-51b2d13f2aa0" returned: 0 in 0.496s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-quobyte-74cb234f-d510-458e-af46-51b2d13f2aa0" released by "_delete_snapshot" :: held 3.201s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-quobyte-7122e987-101e-420e-a0a6-3435463f97cb" released by "delete_snapshot" :: held 3.245s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] Created reservations ['b6f022b4-659a-41ec-a09f-debb2bb7dd29', '767fccf4-9bfe-4ab7-bdba-4f92d1af6fea', '031cca26-6fb4-4f3c-bdbf-176b36792b00', 'b726599e-83d6-4ba1-97d8-48c50b8b9625'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:38:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] Delete snapshot completed successfully. Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bddac46d-6fa1-4c34-888a-15ca2a3a30d8 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-74cb234f-d510-458e-af46-51b2d13f2aa0-delete_snapshot" released by "delete_snapshot" :: held 3.578s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Flow 'volume_create_manager' (9e0c343d-a8eb-45fb-9c9f-ac9d512b3408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1102c2c1-b33f-435a-a88b-ef3e8d41bcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1102c2c1-b33f-435a-a88b-ef3e8d41bcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-567472683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026b5be1-e594-4a76-86cc-55c333fae9d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9f76ab22b04144a4d17c8e631e4461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:38:26Z,use_quota=True,user_id='73d8dbf0e71b4d5baec8070b3fe04ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfca2549-fc1c-45cc-b1b9-3b160025e75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfca2549-fc1c-45cc-b1b9-3b160025e75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0033ca11-87a3-45b5-aa1d-d80b04cba56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0033ca11-87a3-45b5-aa1d-d80b04cba56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '026b5be1-e594-4a76-86cc-55c333fae9d9', 'volume_name': 'volume-026b5be1-e594-4a76-86cc-55c333fae9d9', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b6f449-9294-45ea-9e93-375d5804319e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b6f449-9294-45ea-9e93-375d5804319e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f175557-f8fd-4ae2-83d7-c6b030feb390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:25 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Volume 026b5be1-e594-4a76-86cc-55c333fae9d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-026b5be1-e594-4a76-86cc-55c333fae9d9', 'volume_size': 1} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-567472683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026b5be1-e594-4a76-86cc-55c333fae9d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9f76ab22b04144a4d17c8e631e4461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:38:26Z,use_quota=True,user_id='73d8dbf0e71b4d5baec8070b3fe04ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Creating volume 026b5be1-e594-4a76-86cc-55c333fae9d9 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:38:25 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:38:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-026b5be1-e594-4a76-86cc-55c333fae9d9 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:25 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-026b5be1-e594-4a76-86cc-55c333fae9d9 1073741824 Jul 13 20:38:25 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:26 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-026b5be1-e594-4a76-86cc-55c333fae9d9 1073741824" returned: 0 in 0.420s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-026b5be1-e594-4a76-86cc-55c333fae9d9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:26 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-026b5be1-e594-4a76-86cc-55c333fae9d9 Jul 13 20:38:26 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] Acquiring lock "cinder-7424fcbc-4ee7-45fd-86cb-fb35c111dcf0-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-7424fcbc-4ee7-45fd-86cb-fb35c111dcf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] Acquiring lock "cinder-quobyte-7122e987-101e-420e-a0a6-3435463f97cb" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-quobyte-7122e987-101e-420e-a0a6-3435463f97cb" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] Acquiring lock "cinder-quobyte-7424fcbc-4ee7-45fd-86cb-fb35c111dcf0" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-quobyte-7424fcbc-4ee7-45fd-86cb-fb35c111dcf0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] Deleting offline snapshot 7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 of volume 7122e987-101e-420e-a0a6-3435463f97cb {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:38:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] snapshot_file for this snap is: volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:38:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bd7142-a334-49fb-aeba-ac9d7c0607b6]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:38:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:26 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-026b5be1-e594-4a76-86cc-55c333fae9d9" returned: 0 in 0.323s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:38:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f175557-f8fd-4ae2-83d7-c6b030feb390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-026b5be1-e594-4a76-86cc-55c333fae9d9', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9913870c-ca9d-45ee-9d34-226240d22b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:26 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Volume volume-026b5be1-e594-4a76-86cc-55c333fae9d9 (026b5be1-e594-4a76-86cc-55c333fae9d9): created successfully Jul 13 20:38:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9913870c-ca9d-45ee-9d34-226240d22b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Flow 'volume_create_manager' (9e0c343d-a8eb-45fb-9c9f-ac9d512b3408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:38:26 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-26197bcc-4ee8-4900-b821-3be41e661a62 tempest-VolumesActionsTest-1859263553 None] Created volume successfully. Jul 13 20:38:26 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 Jul 13 20:38:26 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:27 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0" returned: 0 in 0.407s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7122e987-101e-420e-a0a6-3435463f97cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:38:27 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c991684-3391-4c49-9bdc-218e94712c25]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:38:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:27 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb Jul 13 20:38:27 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:27 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb" returned: 0 in 0.376s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:27 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 Jul 13 20:38:27 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:27 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0" returned: 0 in 0.385s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:27 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0 Jul 13 20:38:27 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] Acquiring lock "cinder-026b5be1-e594-4a76-86cc-55c333fae9d9-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] Lock "cinder-026b5be1-e594-4a76-86cc-55c333fae9d9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] Acquiring lock "cinder-quobyte-026b5be1-e594-4a76-86cc-55c333fae9d9" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] Lock "cinder-quobyte-026b5be1-e594-4a76-86cc-55c333fae9d9" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[980fad8f-6c8f-4e08-b292-045654505f11]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-026b5be1-e594-4a76-86cc-55c333fae9d9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:28 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb.7424fcbc-4ee7-45fd-86cb-fb35c111dcf0" returned: 0 in 0.285s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-quobyte-7424fcbc-4ee7-45fd-86cb-fb35c111dcf0" released by "_delete_snapshot" :: held 1.567s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-quobyte-7122e987-101e-420e-a0a6-3435463f97cb" released by "delete_snapshot" :: held 1.601s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:28 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-026b5be1-e594-4a76-86cc-55c333fae9d9 Jul 13 20:38:28 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] Created reservations ['411df155-8260-4394-b3df-a5bc7a728ac4', 'a8267a77-27a2-4608-adbe-3c2bb3593729', '9427cc5c-93da-43bf-8bae-a91b0a89b8ac', 'b2cedf83-6ffa-4a44-89b3-b319851d52c2'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:38:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] Delete snapshot completed successfully. Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b8a41f8c-4ca0-4466-b118-22dcdc479fb6 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-7424fcbc-4ee7-45fd-86cb-fb35c111dcf0-delete_snapshot" released by "delete_snapshot" :: held 1.760s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:28 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-026b5be1-e594-4a76-86cc-55c333fae9d9" returned: 0 in 0.378s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-026b5be1-e594-4a76-86cc-55c333fae9d9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:28 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-026b5be1-e594-4a76-86cc-55c333fae9d9 Jul 13 20:38:28 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:28 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-026b5be1-e594-4a76-86cc-55c333fae9d9" returned: 0 in 0.264s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] Acquiring lock "cinder-7122e987-101e-420e-a0a6-3435463f97cb-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] Lock "cinder-quobyte-026b5be1-e594-4a76-86cc-55c333fae9d9" released by "delete_volume" :: held 0.700s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-7122e987-101e-420e-a0a6-3435463f97cb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] Acquiring lock "cinder-quobyte-7122e987-101e-420e-a0a6-3435463f97cb" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-quobyte-7122e987-101e-420e-a0a6-3435463f97cb" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] Created reservations ['368df559-999d-43cc-9dcd-c49eaed9c6b7', '580187ae-3dc8-42d4-864d-fb60e968f63c', 'ffe4579d-e630-48e1-8913-55d08634363e', 'fc1bc40d-bb7b-403c-8ca1-786f1d6c3371'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c5e4f3-e62d-4a68-a726-fff86c495638]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:29 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:38:29 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:29 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb Jul 13 20:38:29 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:29 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.310s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:38:29 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb" returned: 0 in 0.397s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:29 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] Deleted volume successfully. Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4078d81a-2d0b-43ba-9da3-8364576934fa tempest-VolumesActionsTest-1071384797 None] Lock "cinder-026b5be1-e594-4a76-86cc-55c333fae9d9-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:29 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb Jul 13 20:38:29 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:29 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7122e987-101e-420e-a0a6-3435463f97cb" returned: 0 in 0.350s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-quobyte-7122e987-101e-420e-a0a6-3435463f97cb" released by "delete_volume" :: held 0.816s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] Created reservations ['f17845b4-5cfc-4052-9976-c5ec8c464cc2', '9f9a301c-4ef0-43d6-859d-9f7600712794', '72676a24-c025-4bf2-b201-0f02eeeaa363', 'b0fd7ad7-9990-49ed-ac8d-13884575b416'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Flow 'volume_create_manager' (c68984d3-2546-40ec-86e3-708920d9ba31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0cecc2a-730b-4087-9856-b7db2492d36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0cecc2a-730b-4087-9856-b7db2492d36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2033876562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9f76ab22b04144a4d17c8e631e4461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:38:30Z,use_quota=True,user_id='73d8dbf0e71b4d5baec8070b3fe04ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e443c495-36d4-4027-9258-e8b876e9cfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e443c495-36d4-4027-9258-e8b876e9cfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e8e278-378c-4641-a93f-53eb1a1dd5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e8e278-378c-4641-a93f-53eb1a1dd5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374', 'volume_name': 'volume-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1f1333-5405-4f73-b1b2-7796f4e14f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1f1333-5405-4f73-b1b2-7796f4e14f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e2078b-db4b-4b17-bb37-4de48b3c90f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:29 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Volume dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374', 'volume_size': 1} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2033876562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9f76ab22b04144a4d17c8e631e4461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:38:30Z,use_quota=True,user_id='73d8dbf0e71b4d5baec8070b3fe04ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Creating volume dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:38:29 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:29 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374 1073741824 Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:38:29 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:30 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:38:30 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:30 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.272s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:30 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:38:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] Deleted volume successfully. Jul 13 20:38:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-43818692-1d35-41fe-878d-f0b6631e66d7 tempest-VolumesSnapshotListTestJSON-1258850121 None] Lock "cinder-7122e987-101e-420e-a0a6-3435463f97cb-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:30 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374 1073741824" returned: 0 in 0.617s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:30 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374 Jul 13 20:38:30 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:30 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374" returned: 0 in 0.296s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:38:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e2078b-db4b-4b17-bb37-4de48b3c90f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c60014-50ef-44d4-87db-d80e39d26909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:30 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Volume volume-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374 (dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374): created successfully Jul 13 20:38:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c60014-50ef-44d4-87db-d80e39d26909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Flow 'volume_create_manager' (c68984d3-2546-40ec-86e3-708920d9ba31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:38:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-395cf79e-6d8f-4d5c-a53e-aa7bc3973211 tempest-VolumesActionsTest-1859263553 None] Created volume successfully. Jul 13 20:38:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] Acquiring lock "cinder-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] Lock "cinder-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] Acquiring lock "cinder-quobyte-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] Lock "cinder-quobyte-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:32 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8094ab-521e-49bc-8dbd-c6e641bce8e6]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:38:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:32 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374 Jul 13 20:38:32 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:32 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374" returned: 0 in 0.490s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:32 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374 Jul 13 20:38:32 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:33 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374" returned: 0 in 0.398s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] Lock "cinder-quobyte-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374" released by "delete_volume" :: held 0.942s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:33 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] Created reservations ['942d764c-cb8a-401e-99a5-5d7ac92bd463', 'e0c2748e-6213-4bff-b766-7b72adbccefd', '3a5970e2-d113-4b81-9117-c66cbc7fdc81', 'a5e5c923-8498-4027-a2ad-b87d7d1569d5'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:38:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:38:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:38:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:33 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:38:33 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:33 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.388s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:33 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:38:33 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] Deleted volume successfully. Jul 13 20:38:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e2d2fb49-8fef-4c43-9675-48599245135b tempest-VolumesActionsTest-1071384797 None] Lock "cinder-dbe8fa1b-1f96-48d0-8ed0-e8001f2e4374-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Flow 'volume_create_manager' (32338dce-99ed-4a91-b26e-09039cacb4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03acd14f-45f5-4d8f-9930-3e7ccac3f0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03acd14f-45f5-4d8f-9930-3e7ccac3f0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1764179520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9f76ab22b04144a4d17c8e631e4461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:38:35Z,use_quota=True,user_id='73d8dbf0e71b4d5baec8070b3fe04ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62f3a01-4f48-4ece-8677-aeb651ec42c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62f3a01-4f48-4ece-8677-aeb651ec42c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e2b3ee-0fe8-4a01-a324-6a1300c844a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e2b3ee-0fe8-4a01-a324-6a1300c844a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5', 'volume_name': 'volume-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956ea33e-e108-4236-975d-14872ac115e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956ea33e-e108-4236-975d-14872ac115e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a65d46-676b-45ac-9b94-79f98274455f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:35 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Volume dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5', 'volume_size': 1} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1764179520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9f76ab22b04144a4d17c8e631e4461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:38:35Z,use_quota=True,user_id='73d8dbf0e71b4d5baec8070b3fe04ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Creating volume dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:38:35 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:35 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5 1073741824 Jul 13 20:38:35 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:35 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5 1073741824" returned: 0 in 0.507s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:35 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5 Jul 13 20:38:35 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:36 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5" returned: 0 in 0.307s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:38:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a65d46-676b-45ac-9b94-79f98274455f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (172d2b21-106c-481d-8837-8137e236f4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:36 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Volume volume-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5 (dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5): created successfully Jul 13 20:38:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (172d2b21-106c-481d-8837-8137e236f4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Flow 'volume_create_manager' (32338dce-99ed-4a91-b26e-09039cacb4e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:38:36 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-245d2798-0cbb-44bc-aaca-7b4f3bf9dbb5 tempest-VolumesActionsTest-1859263553 None] Created volume successfully. Jul 13 20:38:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] Acquiring lock "cinder-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] Lock "cinder-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] Acquiring lock "cinder-quobyte-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] Lock "cinder-quobyte-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:37 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bd72d3-fb76-4a38-9b08-4b76ead40d4d]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:38:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:37 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5 Jul 13 20:38:37 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:37 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5" returned: 0 in 0.452s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:37 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5 Jul 13 20:38:37 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:38 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5" returned: 0 in 0.278s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] Lock "cinder-quobyte-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5" released by "delete_volume" :: held 0.778s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:38 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] Created reservations ['b950a3b7-5b7e-4a04-9ce7-78dcb5307851', 'b921f170-9c44-4e64-9791-34064cefee9b', 'bead8e4f-f8be-47d3-95b0-3f3d3d027db8', 'b2172020-125f-4fbe-8b2e-ec4749b23361'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:38:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:38:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:38:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:38 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:38:38 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:38 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.263s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:38 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:38:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] Deleted volume successfully. Jul 13 20:38:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-91750058-cf55-41a8-b1d5-33b4a36fddd1 tempest-VolumesActionsTest-1071384797 None] Lock "cinder-dd4ea1b2-66ca-4402-9e2e-f38bfaaa39d5-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Flow 'volume_create_manager' (1578c227-5090-4857-b5e1-4850fd1c806c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57649ad-340d-437a-a80d-0fe099257254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57649ad-340d-437a-a80d-0fe099257254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-976639772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4bb1818-103d-4103-ab44-d3cf65f399b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9f76ab22b04144a4d17c8e631e4461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:38:39Z,use_quota=True,user_id='73d8dbf0e71b4d5baec8070b3fe04ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ea7788-bc49-4b74-90b8-9c90f50ec238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ea7788-bc49-4b74-90b8-9c90f50ec238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca508fd1-9726-4aa8-afff-591a6f662d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca508fd1-9726-4aa8-afff-591a6f662d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4bb1818-103d-4103-ab44-d3cf65f399b0', 'volume_name': 'volume-f4bb1818-103d-4103-ab44-d3cf65f399b0', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39fece89-6b89-4cc0-b9de-e133610e1020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39fece89-6b89-4cc0-b9de-e133610e1020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d1cf75-1135-4d66-a1e4-25c1984debf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:39 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Volume f4bb1818-103d-4103-ab44-d3cf65f399b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4bb1818-103d-4103-ab44-d3cf65f399b0', 'volume_size': 1} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-976639772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4bb1818-103d-4103-ab44-d3cf65f399b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9f76ab22b04144a4d17c8e631e4461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:38:39Z,use_quota=True,user_id='73d8dbf0e71b4d5baec8070b3fe04ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Creating volume f4bb1818-103d-4103-ab44-d3cf65f399b0 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:38:39 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f4bb1818-103d-4103-ab44-d3cf65f399b0 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:39 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f4bb1818-103d-4103-ab44-d3cf65f399b0 1073741824 Jul 13 20:38:39 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:39 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f4bb1818-103d-4103-ab44-d3cf65f399b0 1073741824" returned: 0 in 0.424s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f4bb1818-103d-4103-ab44-d3cf65f399b0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:39 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f4bb1818-103d-4103-ab44-d3cf65f399b0 Jul 13 20:38:39 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:39 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f4bb1818-103d-4103-ab44-d3cf65f399b0" returned: 0 in 0.245s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d1cf75-1135-4d66-a1e4-25c1984debf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4bb1818-103d-4103-ab44-d3cf65f399b0', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a826bf19-d228-4814-8a9f-edaed9227d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:39 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Volume volume-f4bb1818-103d-4103-ab44-d3cf65f399b0 (f4bb1818-103d-4103-ab44-d3cf65f399b0): created successfully Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a826bf19-d228-4814-8a9f-edaed9227d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Flow 'volume_create_manager' (1578c227-5090-4857-b5e1-4850fd1c806c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:38:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4ddba196-74f2-4054-be12-7d330a78ab10 tempest-VolumesActionsTest-1859263553 None] Created volume successfully. Jul 13 20:38:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] Acquiring lock "cinder-f4bb1818-103d-4103-ab44-d3cf65f399b0-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] Lock "cinder-f4bb1818-103d-4103-ab44-d3cf65f399b0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] Acquiring lock "cinder-quobyte-f4bb1818-103d-4103-ab44-d3cf65f399b0" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] Lock "cinder-quobyte-f4bb1818-103d-4103-ab44-d3cf65f399b0" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:40 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[774ae422-5f9a-4246-8416-a853d673e55c]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:38:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f4bb1818-103d-4103-ab44-d3cf65f399b0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:40 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f4bb1818-103d-4103-ab44-d3cf65f399b0 Jul 13 20:38:40 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:40 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f4bb1818-103d-4103-ab44-d3cf65f399b0" returned: 0 in 0.419s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f4bb1818-103d-4103-ab44-d3cf65f399b0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:40 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f4bb1818-103d-4103-ab44-d3cf65f399b0 Jul 13 20:38:40 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:41 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f4bb1818-103d-4103-ab44-d3cf65f399b0" returned: 0 in 0.256s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] Lock "cinder-quobyte-f4bb1818-103d-4103-ab44-d3cf65f399b0" released by "delete_volume" :: held 0.717s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:41 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] Created reservations ['8a4d2217-ec6e-4f8f-a429-fa3e698c9975', '8e37cf44-a6b5-4fcb-be8d-862996bedd82', '4e420f2e-aaff-42d2-9613-0d40daa37f6b', 'c2871944-de12-4874-8bec-e0f60c781a24'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:38:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:38:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:38:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:41 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:38:41 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:41 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.271s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:41 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:38:41 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] Deleted volume successfully. Jul 13 20:38:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dc1e60a0-4c33-41b0-a8f1-1fb331926a11 tempest-VolumesActionsTest-1071384797 None] Lock "cinder-f4bb1818-103d-4103-ab44-d3cf65f399b0-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Flow 'volume_create_manager' (87538532-c2bd-464e-a6b1-beb14a5bfbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667c9094-1307-49b8-ad4b-f353d55863eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667c9094-1307-49b8-ad4b-f353d55863eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-634977873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14d7a508-675c-49aa-9927-e879476ee467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9f76ab22b04144a4d17c8e631e4461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:38:42Z,use_quota=True,user_id='73d8dbf0e71b4d5baec8070b3fe04ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c85f85-43a7-4d25-947c-dec1e18fcdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c85f85-43a7-4d25-947c-dec1e18fcdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcde0a92-73e6-4514-81a6-95e6d40c0374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcde0a92-73e6-4514-81a6-95e6d40c0374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14d7a508-675c-49aa-9927-e879476ee467', 'volume_name': 'volume-14d7a508-675c-49aa-9927-e879476ee467', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7979e8-00ba-4d41-8887-7b4bbdea7183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7979e8-00ba-4d41-8887-7b4bbdea7183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe2a966-4ee8-4d74-9be4-53b47b7ccf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:42 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Volume 14d7a508-675c-49aa-9927-e879476ee467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14d7a508-675c-49aa-9927-e879476ee467', 'volume_size': 1} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-634977873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14d7a508-675c-49aa-9927-e879476ee467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9f76ab22b04144a4d17c8e631e4461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:38:42Z,use_quota=True,user_id='73d8dbf0e71b4d5baec8070b3fe04ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Creating volume 14d7a508-675c-49aa-9927-e879476ee467 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:38:42 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-14d7a508-675c-49aa-9927-e879476ee467 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:42 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-14d7a508-675c-49aa-9927-e879476ee467 1073741824 Jul 13 20:38:42 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:42 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-14d7a508-675c-49aa-9927-e879476ee467 1073741824" returned: 0 in 0.473s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-14d7a508-675c-49aa-9927-e879476ee467 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:42 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-14d7a508-675c-49aa-9927-e879476ee467 Jul 13 20:38:42 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:42 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-14d7a508-675c-49aa-9927-e879476ee467" returned: 0 in 0.310s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe2a966-4ee8-4d74-9be4-53b47b7ccf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14d7a508-675c-49aa-9927-e879476ee467', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46703735-6ad2-4d3c-8341-3c5c8c079995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:38:43 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Volume volume-14d7a508-675c-49aa-9927-e879476ee467 (14d7a508-675c-49aa-9927-e879476ee467): created successfully Jul 13 20:38:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46703735-6ad2-4d3c-8341-3c5c8c079995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:38:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Flow 'volume_create_manager' (87538532-c2bd-464e-a6b1-beb14a5bfbf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:38:43 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-cf70cbe0-186e-49ff-b100-92df91b3d1af tempest-VolumesActionsTest-1859263553 None] Created volume successfully. Jul 13 20:38:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] Acquiring lock "cinder-14d7a508-675c-49aa-9927-e879476ee467-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] Lock "cinder-14d7a508-675c-49aa-9927-e879476ee467-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] Acquiring lock "cinder-quobyte-14d7a508-675c-49aa-9927-e879476ee467" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] Lock "cinder-quobyte-14d7a508-675c-49aa-9927-e879476ee467" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e69b85c-c7bd-472c-8f5a-25d112412aa5]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:38:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-14d7a508-675c-49aa-9927-e879476ee467 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:45 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-14d7a508-675c-49aa-9927-e879476ee467 Jul 13 20:38:45 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:45 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-14d7a508-675c-49aa-9927-e879476ee467" returned: 0 in 0.600s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-14d7a508-675c-49aa-9927-e879476ee467 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:45 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-14d7a508-675c-49aa-9927-e879476ee467 Jul 13 20:38:45 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:46 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-14d7a508-675c-49aa-9927-e879476ee467" returned: 0 in 0.584s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] Lock "cinder-quobyte-14d7a508-675c-49aa-9927-e879476ee467" released by "delete_volume" :: held 1.297s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:46 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] Created reservations ['f2b71eb5-a871-428f-b06a-37f5460af124', 'a3f884aa-a5ba-4fa1-bada-21073b6b08fa', 'b3fac3aa-816d-4575-a77d-4f160e6d92b6', '90e114c4-4304-4352-a02b-3381201d5059'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:38:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:38:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:38:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:46 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:38:46 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:46 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.287s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:46 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:38:46 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] Deleted volume successfully. Jul 13 20:38:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e9c0fd5f-cf3d-4906-ac74-631c904f4ebf tempest-VolumesActionsTest-1859263553 None] Lock "cinder-14d7a508-675c-49aa-9927-e879476ee467-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-f8e49601-aa76-4255-8070-e196d4a50b51 req-52ea4c6c-dd77-48b4-979e-e20706ae4c46 tempest-TestMinimumBasicScenario-251406228 None] Terminate volume connection completed successfully. Jul 13 20:38:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-f8e49601-aa76-4255-8070-e196d4a50b51 req-52ea4c6c-dd77-48b4-979e-e20706ae4c46 tempest-TestMinimumBasicScenario-251406228 None] Deleting attachment 4c558d6f-96dd-413e-9f5f-61db5f37c8e7. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:38:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] Acquiring lock "cinder-b24778fc-474a-45e0-85b1-72cae16452a7-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] Lock "cinder-b24778fc-474a-45e0-85b1-72cae16452a7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] Acquiring lock "cinder-quobyte-b24778fc-474a-45e0-85b1-72cae16452a7" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:38:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] Lock "cinder-quobyte-b24778fc-474a-45e0-85b1-72cae16452a7" acquired by "delete_volume" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:38:55 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd2b903-0e25-47f9-8c70-aa7be92255d6]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:38:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b24778fc-474a-45e0-85b1-72cae16452a7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:55 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b24778fc-474a-45e0-85b1-72cae16452a7 Jul 13 20:38:55 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:56 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b24778fc-474a-45e0-85b1-72cae16452a7" returned: 0 in 0.424s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b24778fc-474a-45e0-85b1-72cae16452a7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:56 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b24778fc-474a-45e0-85b1-72cae16452a7 Jul 13 20:38:56 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:56 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b24778fc-474a-45e0-85b1-72cae16452a7" returned: 0 in 0.271s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] Lock "cinder-quobyte-b24778fc-474a-45e0-85b1-72cae16452a7" released by "delete_volume" :: held 0.746s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:38:56 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:INSERT=30,cinder:UPDATE=107,cinder:SELECT=80,cinder:DELETE=11 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:38:56 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] Created reservations ['d8a36021-06e2-4e29-babe-3c9fb18559ea', '9a5b5114-1e26-4811-af2f-8a9317fa2579', '7db41eef-29d6-450d-9634-255ea6b8bb86', '9d84e27a-e47d-4b69-b6ff-f7627f307621'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:38:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:38:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:38:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:38:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:38:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:38:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:38:56 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:38:56 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:38:56 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Jul 13 20:38:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.337s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:38:56 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:38:56 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] Deleted volume successfully. Jul 13 20:38:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8a82ba68-53c0-43b3-a509-9a2951cfc8da tempest-TestMinimumBasicScenario-251406228 None] Lock "cinder-b24778fc-474a-45e0-85b1-72cae16452a7-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=93,cinder:INSERT=23,cinder:UPDATE=113,cinder:DELETE=7 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Flow 'volume_create_manager' (22016720-870e-4a38-8200-b5292bcb27e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e747af77-a674-4271-a828-11c173a2e6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e747af77-a674-4271-a828-11c173a2e6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1471784206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8966a65-d6c8-401f-8bb7-2f3e4cedfb51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9c4a047e3b4617a55d67653f3b659d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:02Z,use_quota=True,user_id='b7b5bc066db8488183693673ce2d573d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d386d71-82c5-4e16-a0d7-f63d3190e66e),volume_type_id=2d386d71-82c5-4e16-a0d7-f63d3190e66e)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc08d5d-dd21-4f07-9727-061b94d0b99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc08d5d-dd21-4f07-9727-061b94d0b99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416ce66f-5ca9-4723-9862-13329d19b40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416ce66f-5ca9-4723-9862-13329d19b40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8966a65-d6c8-401f-8bb7-2f3e4cedfb51', 'volume_name': 'volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc033bd-61e0-4de5-8541-43e705836546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc033bd-61e0-4de5-8541-43e705836546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573da5d0-601f-4beb-bbbc-a226b5b4234c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:02 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Volume b8966a65-d6c8-401f-8bb7-2f3e4cedfb51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51', 'volume_size': 1} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1471784206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8966a65-d6c8-401f-8bb7-2f3e4cedfb51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9c4a047e3b4617a55d67653f3b659d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:02Z,use_quota=True,user_id='b7b5bc066db8488183693673ce2d573d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d386d71-82c5-4e16-a0d7-f63d3190e66e),volume_type_id=2d386d71-82c5-4e16-a0d7-f63d3190e66e)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Creating volume b8966a65-d6c8-401f-8bb7-2f3e4cedfb51 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:39:02 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:39:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:02 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51 1073741824 Jul 13 20:39:02 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:03 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:39:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Flow 'volume_create_manager' (22b82d8a-6b9a-48df-9dde-33b37b42f081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9044af-08f6-4ff5-a5d7-312e437785ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9044af-08f6-4ff5-a5d7-312e437785ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1394962309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef54f9b0-4204-4443-85fa-7dbb704612f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9c4a047e3b4617a55d67653f3b659d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:03Z,use_quota=True,user_id='b7b5bc066db8488183693673ce2d573d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5eb3390-9966-40d6-bbb4-af15a9ec8595),volume_type_id=b5eb3390-9966-40d6-bbb4-af15a9ec8595)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39afd70f-4527-494d-bf6f-aeb46385ff14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39afd70f-4527-494d-bf6f-aeb46385ff14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae09138b-58b6-4b8b-95ec-813437d66633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae09138b-58b6-4b8b-95ec-813437d66633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef54f9b0-4204-4443-85fa-7dbb704612f8', 'volume_name': 'volume-ef54f9b0-4204-4443-85fa-7dbb704612f8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8652027a-19c9-46dc-9ddd-8874844e68c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8652027a-19c9-46dc-9ddd-8874844e68c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc3f11f-18b2-441f-a9bc-4684165629f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:03 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Volume ef54f9b0-4204-4443-85fa-7dbb704612f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef54f9b0-4204-4443-85fa-7dbb704612f8', 'volume_size': 1} Jul 13 20:39:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:03 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51 1073741824" returned: 0 in 0.941s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:03 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51 Jul 13 20:39:03 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:04 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51" returned: 0 in 0.335s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.545s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1394962309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef54f9b0-4204-4443-85fa-7dbb704612f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9c4a047e3b4617a55d67653f3b659d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:03Z,use_quota=True,user_id='b7b5bc066db8488183693673ce2d573d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5eb3390-9966-40d6-bbb4-af15a9ec8595),volume_type_id=b5eb3390-9966-40d6-bbb4-af15a9ec8595)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Creating volume ef54f9b0-4204-4443-85fa-7dbb704612f8 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:39:04 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ef54f9b0-4204-4443-85fa-7dbb704612f8 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573da5d0-601f-4beb-bbbc-a226b5b4234c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:04 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ef54f9b0-4204-4443-85fa-7dbb704612f8 1073741824 Jul 13 20:39:04 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6f6f18-c53f-4b69-8419-8157e7b55e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Volume volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51 (b8966a65-d6c8-401f-8bb7-2f3e4cedfb51): created successfully Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6f6f18-c53f-4b69-8419-8157e7b55e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Flow 'volume_create_manager' (22016720-870e-4a38-8200-b5292bcb27e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7bf1eed6-98ba-4d87-9c89-66af6103fcb9 tempest-TestInstancesWithCinderVolumes-1133704955 None] Created volume successfully. Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Flow 'volume_create_manager' (80c233fe-fde8-4d35-a48f-aa823e575987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fa5661-43eb-4a7d-8037-1a6e0a426b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fa5661-43eb-4a7d-8037-1a6e0a426b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1361151405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118e913c-289e-47f7-866e-65de85b35564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9c4a047e3b4617a55d67653f3b659d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:05Z,use_quota=True,user_id='b7b5bc066db8488183693673ce2d573d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc9aa84d-09a9-4422-b305-da19379dc79b),volume_type_id=bc9aa84d-09a9-4422-b305-da19379dc79b)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da8b996-ca01-4011-901a-8db5b7f6e3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da8b996-ca01-4011-901a-8db5b7f6e3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b189cea-c45e-484f-a5cd-3fa18f958606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG cinder.image.glance [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Creating Keystone auth plugin from conf {{(pid=87269) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 13 20:39:04 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ef54f9b0-4204-4443-85fa-7dbb704612f8 1073741824" returned: 0 in 0.826s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ef54f9b0-4204-4443-85fa-7dbb704612f8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:04 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ef54f9b0-4204-4443-85fa-7dbb704612f8 Jul 13 20:39:04 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:05 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ef54f9b0-4204-4443-85fa-7dbb704612f8" returned: 0 in 0.319s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:39:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc3f11f-18b2-441f-a9bc-4684165629f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef54f9b0-4204-4443-85fa-7dbb704612f8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ae11e0-54ac-43e9-979d-4ccf3c59aa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Volume volume-ef54f9b0-4204-4443-85fa-7dbb704612f8 (ef54f9b0-4204-4443-85fa-7dbb704612f8): created successfully Jul 13 20:39:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ae11e0-54ac-43e9-979d-4ccf3c59aa09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Flow 'volume_create_manager' (22b82d8a-6b9a-48df-9dde-33b37b42f081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1eee2711-d577-4866-bf19-83a417035cdb tempest-TestInstancesWithCinderVolumes-1133704955 None] Created volume successfully. Jul 13 20:39:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b189cea-c45e-484f-a5cd-3fa18f958606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '118e913c-289e-47f7-866e-65de85b35564', 'volume_name': 'volume-118e913c-289e-47f7-866e-65de85b35564', 'volume_size': 1, 'image_id': '217b1d73-fd06-423d-8b8d-50fb68d8eb56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/217b1d73-fd06-423d-8b8d-50fb68d8eb56', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--265171198', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6d9c4a047e3b4617a55d67653f3b659d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '217b1d73-fd06-423d-8b8d-50fb68d8eb56', 'created_at': datetime.datetime(2026, 7, 13, 18, 38, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 39, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/217b1d73-fd06-423d-8b8d-50fb68d8eb56/file', 'properties': {}}, 'image_service': }' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8475bcd3-4337-4851-ab52-30527796d0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8475bcd3-4337-4851-ab52-30527796d0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea807bcd-e4ab-4326-a243-b48e6069bebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Volume 118e913c-289e-47f7-866e-65de85b35564: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-118e913c-289e-47f7-866e-65de85b35564', 'volume_size': 1, 'image_id': '217b1d73-fd06-423d-8b8d-50fb68d8eb56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/217b1d73-fd06-423d-8b8d-50fb68d8eb56', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--265171198', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6d9c4a047e3b4617a55d67653f3b659d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '217b1d73-fd06-423d-8b8d-50fb68d8eb56', 'created_at': datetime.datetime(2026, 7, 13, 18, 38, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 39, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/217b1d73-fd06-423d-8b8d-50fb68d8eb56/file', 'properties': {}}, 'image_service': } Jul 13 20:39:05 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Trying to clone 118e913c-289e-47f7-866e-65de85b35564 from image 217b1d73-fd06-423d-8b8d-50fb68d8eb56 at location (None, [{'url': 'file:///opt/stack/data/glance/images/217b1d73-fd06-423d-8b8d-50fb68d8eb56', 'metadata': {}}]). {{(pid=87269) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 13 20:39:10 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_217b1d73-fd06-423d-8b8d-50fb68d8eb56_b91zu_d1devstack@QuobyteHD, size 20.69 MB, duration 5.24 sec {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 13 20:39:10 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Image download 20.69 MB at 3.95 MB/s Jul 13 20:39:10 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[283f630d-7160-411a-956a-19fb226ac15d]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_217b1d73-fd06-423d-8b8d-50fb68d8eb56_b91zu_d1devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:11 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_217b1d73-fd06-423d-8b8d-50fb68d8eb56_b91zu_d1devstack@QuobyteHD Jul 13 20:39:11 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:11 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_217b1d73-fd06-423d-8b8d-50fb68d8eb56_b91zu_d1devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:11 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Temporary image 217b1d73-fd06-423d-8b8d-50fb68d8eb56 is fetched for user b7b5bc066db8488183693673ce2d573d. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 13 20:39:11 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[80702735-1f2c-4ab3-a69a-0e761374e984]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_217b1d73-fd06-423d-8b8d-50fb68d8eb56_b91zu_d1devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:11 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_217b1d73-fd06-423d-8b8d-50fb68d8eb56_b91zu_d1devstack@QuobyteHD Jul 13 20:39:11 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:12 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_217b1d73-fd06-423d-8b8d-50fb68d8eb56_b91zu_d1devstack@QuobyteHD" returned: 0 in 0.751s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1361151405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118e913c-289e-47f7-866e-65de85b35564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9c4a047e3b4617a55d67653f3b659d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:05Z,use_quota=True,user_id='b7b5bc066db8488183693673ce2d573d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc9aa84d-09a9-4422-b305-da19379dc79b),volume_type_id=bc9aa84d-09a9-4422-b305-da19379dc79b)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:39:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Creating volume 118e913c-289e-47f7-866e-65de85b35564 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:39:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:39:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:39:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:39:12 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:39:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:12 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 1073741824 Jul 13 20:39:12 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:12 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 1073741824" returned: 0 in 0.722s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:13 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 Jul 13 20:39:13 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:13 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564" returned: 0 in 0.484s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:39:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:13 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Attempting download of 217b1d73-fd06-423d-8b8d-50fb68d8eb56 ((None, [{'url': 'file:///opt/stack/data/glance/images/217b1d73-fd06-423d-8b8d-50fb68d8eb56', 'metadata': {}}])) to volume 118e913c-289e-47f7-866e-65de85b35564. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 13 20:39:13 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19ea3fa-a1ee-4360-b1a5-c43fbd6da958]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_217b1d73-fd06-423d-8b8d-50fb68d8eb56_5c5kp2rp {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:13 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_217b1d73-fd06-423d-8b8d-50fb68d8eb56_5c5kp2rp Jul 13 20:39:13 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:14 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_217b1d73-fd06-423d-8b8d-50fb68d8eb56_5c5kp2rp" returned: 0 in 0.639s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_217b1d73-fd06-423d-8b8d-50fb68d8eb56_5c5kp2rp {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:14 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_217b1d73-fd06-423d-8b8d-50fb68d8eb56_5c5kp2rp Jul 13 20:39:14 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:14 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_217b1d73-fd06-423d-8b8d-50fb68d8eb56_5c5kp2rp" returned: 1 in 0.575s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_217b1d73-fd06-423d-8b8d-50fb68d8eb56_5c5kp2rp' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:39:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd41dca-e20e-477d-bd96-a9a55d0a7414]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_217b1d73-fd06-423d-8b8d-50fb68d8eb56_b91zu_d1devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:15 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_217b1d73-fd06-423d-8b8d-50fb68d8eb56_b91zu_d1devstack@QuobyteHD Jul 13 20:39:15 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:15 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_217b1d73-fd06-423d-8b8d-50fb68d8eb56_b91zu_d1devstack@QuobyteHD" returned: 0 in 0.536s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] 217b1d73-fd06-423d-8b8d-50fb68d8eb56 was qcow2, converting to raw {{(pid=87269) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_217b1d73-fd06-423d-8b8d-50fb68d8eb56_b91zu_d1devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:15 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_217b1d73-fd06-423d-8b8d-50fb68d8eb56_b91zu_d1devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 Jul 13 20:39:15 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Flow 'volume_create_manager' (22e7bc69-7dd9-4bbf-a91a-124229930dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c3e318-d712-49d9-a35e-3600c11521d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c3e318-d712-49d9-a35e-3600c11521d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-108835264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ea5ab9-d95a-4911-8bc3-11ef737ee1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b571bf64ed4f6097120c1563551b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:15Z,use_quota=True,user_id='d5029a9dcc2e4afdaddafecd712db702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f324c046-4592-46a0-8833-0944b50cac40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f324c046-4592-46a0-8833-0944b50cac40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4fa23a-b56a-465f-8480-0fb05cd71e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4fa23a-b56a-465f-8480-0fb05cd71e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54ea5ab9-d95a-4911-8bc3-11ef737ee1a0', 'volume_name': 'volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c06f7da-d87a-42f1-8626-3133298ed3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c06f7da-d87a-42f1-8626-3133298ed3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d48acb3-4079-4fa9-bf4f-0533b7ea04b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:15 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Volume 54ea5ab9-d95a-4911-8bc3-11ef737ee1a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0', 'volume_size': 1} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-108835264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ea5ab9-d95a-4911-8bc3-11ef737ee1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b571bf64ed4f6097120c1563551b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:15Z,use_quota=True,user_id='d5029a9dcc2e4afdaddafecd712db702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Creating volume 54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:39:15 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:39:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:15 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 1073741824 Jul 13 20:39:15 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:16 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 1073741824" returned: 0 in 0.803s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:16 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 Jul 13 20:39:16 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:17 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0" returned: 0 in 0.396s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:39:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d48acb3-4079-4fa9-bf4f-0533b7ea04b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a730e70-a7aa-4627-9712-7e545aa44537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:17 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Volume volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 (54ea5ab9-d95a-4911-8bc3-11ef737ee1a0): created successfully Jul 13 20:39:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a730e70-a7aa-4627-9712-7e545aa44537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Flow 'volume_create_manager' (22e7bc69-7dd9-4bbf-a91a-124229930dc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-704c7fde-2474-4024-87df-08b3de4785a7 tempest-VolumesCloneTest-81689932 None] Created volume successfully. Jul 13 20:39:17 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_217b1d73-fd06-423d-8b8d-50fb68d8eb56_b91zu_d1devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564" returned: 0 in 2.136s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:17 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_217b1d73-fd06-423d-8b8d-50fb68d8eb56_b91zu_d1devstack@QuobyteHD, size 112.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:39:17 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Converted 112.00 MB image at 52.38 MB/s Jul 13 20:39:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:17 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 1G Jul 13 20:39:17 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:18 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 1G" returned: 0 in 0.477s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea6a9ac-c4a0-4521-8501-08c4ee1cebd7]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:39:18 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 Jul 13 20:39:18 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Flow 'volume_create_manager' (c250b20a-9c3a-4c96-813b-95ebb1cff1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84b3142-c427-4ac4-aa3f-eb8453cb76c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84b3142-c427-4ac4-aa3f-eb8453cb76c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1715275615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7577fa1f-6224-4c2b-8b0c-7fa1c81999dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b571bf64ed4f6097120c1563551b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=54ea5ab9-d95a-4911-8bc3-11ef737ee1a0,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:18Z,use_quota=True,user_id='d5029a9dcc2e4afdaddafecd712db702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2509eb9-451d-4800-8bb2-689bd7c18450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2509eb9-451d-4800-8bb2-689bd7c18450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a05c417-da0e-4715-803b-b77d731e2293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a05c417-da0e-4715-803b-b77d731e2293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7577fa1f-6224-4c2b-8b0c-7fa1c81999dd', 'volume_name': 'volume-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd', 'volume_size': 2, 'source_volid': '54ea5ab9-d95a-4911-8bc3-11ef737ee1a0', 'source_volstatus': 'available'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a141fb25-d75a-485c-a8a5-eceddc9525cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a141fb25-d75a-485c-a8a5-eceddc9525cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31da0097-fd1d-4d95-9b03-a4d19df4d6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:18 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Volume 7577fa1f-6224-4c2b-8b0c-7fa1c81999dd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd', 'volume_size': 2, 'source_volid': '54ea5ab9-d95a-4911-8bc3-11ef737ee1a0', 'source_volstatus': 'available'} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:18 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Cloning volume 54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 to volume 7577fa1f-6224-4c2b-8b0c-7fa1c81999dd Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Creating offline snapshot 3ca39554-774a-4a20-9403-fb4262fc7bf3 of volume 54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faf5b6c-4e83-48fe-b434-076d1021006f]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:18 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564" returned: 0 in 0.460s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:18 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 Jul 13 20:39:18 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:18 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 Jul 13 20:39:18 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:18 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0" returned: 0 in 0.406s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:18 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:39:18 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:18 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3 1G Jul 13 20:39:18 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:18 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564" returned: 1 in 0.424s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Downloaded image 217b1d73-fd06-423d-8b8d-50fb68d8eb56 ((None, [{'url': 'file:///opt/stack/data/glance/images/217b1d73-fd06-423d-8b8d-50fb68d8eb56', 'metadata': {}}])) to volume 118e913c-289e-47f7-866e-65de85b35564 successfully. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Temporary image 217b1d73-fd06-423d-8b8d-50fb68d8eb56 for user b7b5bc066db8488183693673ce2d573d is deleted. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Marking volume 118e913c-289e-47f7-866e-65de85b35564 as bootable. {{(pid=87269) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Copying metadata from image 217b1d73-fd06-423d-8b8d-50fb68d8eb56 to 118e913c-289e-47f7-866e-65de85b35564. {{(pid=87269) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Creating volume glance metadata for volume 118e913c-289e-47f7-866e-65de85b35564 backed by image 217b1d73-fd06-423d-8b8d-50fb68d8eb56 with: {'image_id': '217b1d73-fd06-423d-8b8d-50fb68d8eb56', 'image_name': 'tempest-scenario-img--265171198', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87269) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea807bcd-e4ab-4326-a243-b48e6069bebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-118e913c-289e-47f7-866e-65de85b35564', 'volume_size': 1, 'image_id': '217b1d73-fd06-423d-8b8d-50fb68d8eb56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/217b1d73-fd06-423d-8b8d-50fb68d8eb56', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--265171198', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6d9c4a047e3b4617a55d67653f3b659d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '217b1d73-fd06-423d-8b8d-50fb68d8eb56', 'created_at': datetime.datetime(2026, 7, 13, 18, 38, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 39, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/217b1d73-fd06-423d-8b8d-50fb68d8eb56/file', 'properties': {}}, 'image_service': }' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2856e12e-fe86-40a1-80d9-5c1e7c5b303c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:19 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Volume volume-118e913c-289e-47f7-866e-65de85b35564 (118e913c-289e-47f7-866e-65de85b35564): created successfully Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2856e12e-fe86-40a1-80d9-5c1e7c5b303c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Flow 'volume_create_manager' (80c233fe-fde8-4d35-a48f-aa823e575987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f6710eaa-8d54-4098-ac9d-aede1d254a86 tempest-TestInstancesWithCinderVolumes-1133704955 None] Created volume successfully. Jul 13 20:39:19 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.514s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:39:19 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3 1G" returned: 0 in 0.536s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:19 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3 Jul 13 20:39:19 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:19 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3" returned: 0 in 0.310s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:19 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3 is being set with open permissions: ugo+rw Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:19 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3 Jul 13 20:39:19 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:19 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3" returned: 0 in 0.265s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:20 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.info Jul 13 20:39:20 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:20 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.info" returned: 0 in 0.354s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:20 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.info is being set with open permissions: ugo+rw Jul 13 20:39:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:20 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.info Jul 13 20:39:20 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:20 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.info" returned: 0 in 0.319s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Acquiring lock "cinder-quobyte-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:39:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Lock "cinder-quobyte-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:39:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] snapshot: 3ca39554-774a-4a20-9403-fb4262fc7bf3, volume: 7577fa1f-6224-4c2b-8b0c-7fa1c81999dd, {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 20:39:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:39:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:39:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2a0a7e-327c-4a13-9d24-93a3c6e0d27f]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:20 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3 Jul 13 20:39:20 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Flow 'volume_create_manager' (e4c5158d-48a9-4d14-9414-86b83e18d010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:21 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e404bbf6-c017-4d89-ab5a-5fcd3927d235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3" returned: 0 in 0.581s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e404bbf6-c017-4d89-ab5a-5fcd3927d235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1612022594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c169765-88e4-41f3-80e2-e239757d8aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f4bef83e9942afad57ab81d2830749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:21Z,use_quota=True,user_id='c43cbc537402495fbba8f7fad09f42f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b18acdb-e631-43c8-a5fe-a076953e5f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b18acdb-e631-43c8-a5fe-a076953e5f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453bbd08-01a8-46bd-ab2c-0fab43e8b996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453bbd08-01a8-46bd-ab2c-0fab43e8b996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c169765-88e4-41f3-80e2-e239757d8aea', 'volume_name': 'volume-4c169765-88e4-41f3-80e2-e239757d8aea', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452d91b0-47e8-4731-bd0e-8d66a63a22fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452d91b0-47e8-4731-bd0e-8d66a63a22fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c378d6-2e8e-45b1-b881-31960f9077e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:21 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Volume 4c169765-88e4-41f3-80e2-e239757d8aea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c169765-88e4-41f3-80e2-e239757d8aea', 'volume_size': 1} Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6fe99d-19b4-489b-8934-a7d4f5a95b2e]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:21 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 Jul 13 20:39:21 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:21 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0" returned: 0 in 0.425s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Path /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 20:39:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:21 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd Jul 13 20:39:21 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-6e734122-34d8-4bb9-aa2f-8639c94bd309 req-edfccef8-da16-4371-854b-5448e91eef16 tempest-TestInstancesWithCinderVolumes-1133704955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:27 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd" returned: 0 in 5.800s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:27 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[79991cc2-6ff0-49cf-a967-71d807b62542]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:27 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 Jul 13 20:39:27 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:28 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0" returned: 0 in 0.569s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:28 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:39:28 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Converted 1024.00 MB image at 176.53 MB/s Jul 13 20:39:28 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd is being set with open permissions: ugo+rw Jul 13 20:39:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:28 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd Jul 13 20:39:28 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:28 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd" returned: 0 in 0.261s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Lock "cinder-quobyte-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd" released by "_copy_volume_from_snapshot" :: held 7.778s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:39:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Acquiring lock "cinder-quobyte-3ca39554-774a-4a20-9403-fb4262fc7bf3" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:39:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Lock "cinder-quobyte-3ca39554-774a-4a20-9403-fb4262fc7bf3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:39:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Deleting offline snapshot 3ca39554-774a-4a20-9403-fb4262fc7bf3 of volume 54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:39:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] snapshot_file for this snap is: volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:39:28 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[162b8112-2118-4f9c-8c2a-d4c7c7a91c37]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:28 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3 Jul 13 20:39:28 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:28 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3" returned: 0 in 0.384s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:39:28 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[59606b07-b725-4024-918c-00bc9d2152be]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:29 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 Jul 13 20:39:29 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:29 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0" returned: 0 in 0.344s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:29 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3 Jul 13 20:39:29 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:29 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3" returned: 0 in 0.307s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:29 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3 Jul 13 20:39:29 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:29 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0.3ca39554-774a-4a20-9403-fb4262fc7bf3" returned: 0 in 0.249s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Lock "cinder-quobyte-3ca39554-774a-4a20-9403-fb4262fc7bf3" released by "_delete_snapshot" :: held 1.387s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:39:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.566s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.553s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1612022594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c169765-88e4-41f3-80e2-e239757d8aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f4bef83e9942afad57ab81d2830749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:21Z,use_quota=True,user_id='c43cbc537402495fbba8f7fad09f42f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:39:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Creating volume 4c169765-88e4-41f3-80e2-e239757d8aea {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:39:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:39:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:39:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:39:29 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:39:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4c169765-88e4-41f3-80e2-e239757d8aea 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31da0097-fd1d-4d95-9b03-a4d19df4d6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd', 'volume_size': 2, 'source_volid': '54ea5ab9-d95a-4911-8bc3-11ef737ee1a0', 'source_volstatus': 'available'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357b73a7-16a4-435b-b52f-dced53df2946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:30 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4c169765-88e4-41f3-80e2-e239757d8aea 1073741824 Jul 13 20:39:30 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:30 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Volume volume-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd (7577fa1f-6224-4c2b-8b0c-7fa1c81999dd): created successfully Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357b73a7-16a4-435b-b52f-dced53df2946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Flow 'volume_create_manager' (c250b20a-9c3a-4c96-813b-95ebb1cff1f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-53a441ac-400d-4f43-930a-04dcb83a9102 tempest-VolumesCloneTest-81689932 None] Created volume successfully. Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] Acquiring lock "cinder-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:39:30 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4c169765-88e4-41f3-80e2-e239757d8aea 1073741824" returned: 0 in 0.554s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] Lock "cinder-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4c169765-88e4-41f3-80e2-e239757d8aea {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] Acquiring lock "cinder-quobyte-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:39:30 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4c169765-88e4-41f3-80e2-e239757d8aea Jul 13 20:39:30 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] Lock "cinder-quobyte-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[93814d47-6de0-4716-8ad9-b6e057bbe9f7]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:30 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd Jul 13 20:39:30 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:30 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4c169765-88e4-41f3-80e2-e239757d8aea" returned: 0 in 0.258s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-6e734122-34d8-4bb9-aa2f-8639c94bd309 req-edfccef8-da16-4371-854b-5448e91eef16 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.094s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c378d6-2e8e-45b1-b881-31960f9077e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c169765-88e4-41f3-80e2-e239757d8aea', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e66647-7f07-44f8-bf35-41843adf9340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:30 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Volume volume-4c169765-88e4-41f3-80e2-e239757d8aea (4c169765-88e4-41f3-80e2-e239757d8aea): created successfully Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e66647-7f07-44f8-bf35-41843adf9340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Flow 'volume_create_manager' (e4c5158d-48a9-4d14-9414-86b83e18d010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabd705e-ea9d-4aff-9029-348583a2c141]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-6e734122-34d8-4bb9-aa2f-8639c94bd309 req-edfccef8-da16-4371-854b-5448e91eef16 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-67788810-6900-474f-9350-a7169472797f tempest-ProjectReaderTests-580912120 None] Created volume successfully. Jul 13 20:39:31 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 Jul 13 20:39:31 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:31 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd" returned: 0 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:31 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd Jul 13 20:39:31 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:31 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-6e734122-34d8-4bb9-aa2f-8639c94bd309 req-edfccef8-da16-4371-854b-5448e91eef16 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564" returned: 0 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-6e734122-34d8-4bb9-aa2f-8639c94bd309 req-edfccef8-da16-4371-854b-5448e91eef16 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:31 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd" returned: 0 in 0.306s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] Lock "cinder-quobyte-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd" released by "delete_volume" :: held 0.758s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:39:31 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 Jul 13 20:39:31 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] Created reservations ['e0ac2839-8368-4c8c-bf6e-096335ee3d15', 'f37bd434-50b4-42a9-b4e5-8b774717f704', '8c1e4554-c2ef-490a-8e50-a035ab60200d', 'a0e801b9-9497-437c-8d2f-d457e6b0f4fb'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] Acquiring lock "cinder-4c169765-88e4-41f3-80e2-e239757d8aea-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] Lock "cinder-4c169765-88e4-41f3-80e2-e239757d8aea-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:31 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:39:31 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] Acquiring lock "cinder-quobyte-4c169765-88e4-41f3-80e2-e239757d8aea" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] Lock "cinder-quobyte-4c169765-88e4-41f3-80e2-e239757d8aea" acquired by "delete_volume" :: waited 0.044s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e30021-f083-49ad-addd-c008e649a141]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4c169765-88e4-41f3-80e2-e239757d8aea {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:31 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-6e734122-34d8-4bb9-aa2f-8639c94bd309 req-edfccef8-da16-4371-854b-5448e91eef16 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564" returned: 1 in 0.584s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-6e734122-34d8-4bb9-aa2f-8639c94bd309 req-edfccef8-da16-4371-854b-5448e91eef16 tempest-TestInstancesWithCinderVolumes-1133704955 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-6e734122-34d8-4bb9-aa2f-8639c94bd309 req-edfccef8-da16-4371-854b-5448e91eef16 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.037s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] Acquiring lock "cinder-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:39:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-6e734122-34d8-4bb9-aa2f-8639c94bd309 req-edfccef8-da16-4371-854b-5448e91eef16 tempest-TestInstancesWithCinderVolumes-1133704955 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-118e913c-289e-47f7-866e-65de85b35564', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d70db71-5728-4e55-8ed1-4dbd12633d99', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:39:32 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] Lock "cinder-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:39:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.334s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:32 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:39:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] Deleted volume successfully. Jul 13 20:39:32 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4c169765-88e4-41f3-80e2-e239757d8aea Jul 13 20:39:32 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2eafae60-4757-4662-ab87-eeb5bf1d89b1 tempest-VolumesCloneTest-81689932 None] Lock "cinder-7577fa1f-6224-4c2b-8b0c-7fa1c81999dd-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:39:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] Acquiring lock "cinder-quobyte-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:39:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-6e734122-34d8-4bb9-aa2f-8639c94bd309 req-edfccef8-da16-4371-854b-5448e91eef16 tempest-TestInstancesWithCinderVolumes-1133704955 None] attachment_update completed successfully. Jul 13 20:39:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] Lock "cinder-quobyte-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:39:32 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfec474-de42-4a25-9d91-d1ba1205fb03]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:32 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 Jul 13 20:39:32 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:32 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4c169765-88e4-41f3-80e2-e239757d8aea" returned: 0 in 0.577s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4c169765-88e4-41f3-80e2-e239757d8aea {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:32 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4c169765-88e4-41f3-80e2-e239757d8aea Jul 13 20:39:32 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:32 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0" returned: 0 in 0.512s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:32 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0 Jul 13 20:39:32 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:32 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4c169765-88e4-41f3-80e2-e239757d8aea" returned: 0 in 0.389s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] Lock "cinder-quobyte-4c169765-88e4-41f3-80e2-e239757d8aea" released by "delete_volume" :: held 1.048s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:39:32 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] Created reservations ['770a51f2-7b0d-480d-9208-4d0671d8274b', '78df4db0-6ea8-4c93-ae0b-4eab26215f56', 'e80e602b-95b7-40ec-af73-d6160b37e86e', '69ffbe7c-34cd-4bef-91fa-1aecc5309c26'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:39:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:39:33 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:39:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0" returned: 0 in 0.557s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:33 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:39:33 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] Lock "cinder-quobyte-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0" released by "delete_volume" :: held 1.218s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:39:33 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] Created reservations ['79f17a8a-3632-484d-a7c7-6d6f2c96915e', '9e0d6edc-674b-4e0e-af4a-2e66960aac3b', '877b5e8c-a539-4b12-a959-fef930edf1f4', '207d9368-7da9-4304-a137-ad352cd6f52d'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:39:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:39:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:39:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:33 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:39:33 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:33 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.543s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:33 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:39:33 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] Deleted volume successfully. Jul 13 20:39:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3cd4ab7c-0ff7-422d-85cd-0d09855ec61d tempest-ProjectReaderTests-580912120 None] Lock "cinder-4c169765-88e4-41f3-80e2-e239757d8aea-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:39:34 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.422s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:34 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:39:34 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] Deleted volume successfully. Jul 13 20:39:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d60fefae-4303-456c-9a50-0f63b1cd8ed9 tempest-VolumesCloneTest-81689932 None] Lock "cinder-54ea5ab9-d95a-4911-8bc3-11ef737ee1a0-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Flow 'volume_create_manager' (21dd7537-1d7e-4481-b10d-a9213d52eb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9da7eb9-591b-454d-b6a4-ff38a8eccd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9da7eb9-591b-454d-b6a4-ff38a8eccd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213633595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1467e67d-80fc-4178-a443-3100e2db1eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f4bef83e9942afad57ab81d2830749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:35Z,use_quota=True,user_id='c43cbc537402495fbba8f7fad09f42f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adce8ef7-f839-4b2e-9fb0-fb7c3f44efac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adce8ef7-f839-4b2e-9fb0-fb7c3f44efac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe71119-1ff5-477d-9a35-19bb6d14d1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe71119-1ff5-477d-9a35-19bb6d14d1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1467e67d-80fc-4178-a443-3100e2db1eca', 'volume_name': 'volume-1467e67d-80fc-4178-a443-3100e2db1eca', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654f7e68-1df4-4511-b619-e8ddebd8a909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654f7e68-1df4-4511-b619-e8ddebd8a909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cb196f-f259-47ec-8259-27d0e441f0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:35 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Volume 1467e67d-80fc-4178-a443-3100e2db1eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1467e67d-80fc-4178-a443-3100e2db1eca', 'volume_size': 1} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213633595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1467e67d-80fc-4178-a443-3100e2db1eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f4bef83e9942afad57ab81d2830749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:35Z,use_quota=True,user_id='c43cbc537402495fbba8f7fad09f42f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Creating volume 1467e67d-80fc-4178-a443-3100e2db1eca {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:39:35 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1467e67d-80fc-4178-a443-3100e2db1eca 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:35 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1467e67d-80fc-4178-a443-3100e2db1eca 1073741824 Jul 13 20:39:35 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Flow 'volume_create_manager' (94c8e135-2c97-43de-b61b-a5f453258b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7459502e-2e7e-4c46-b5b3-089d42221d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7459502e-2e7e-4c46-b5b3-089d42221d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-465477014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c815c6-f7cd-4c5f-8b4e-7081e3deb730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3a5d3fa6c84059969c9f47aa6bc355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:35Z,use_quota=True,user_id='35b9c20eab024637960b20672b7d93c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27bb8401-4813-4278-a45a-73b7baa5fdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27bb8401-4813-4278-a45a-73b7baa5fdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451fbd9e-c9c8-4fb2-99be-1d7f6fa5f1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451fbd9e-c9c8-4fb2-99be-1d7f6fa5f1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7c815c6-f7cd-4c5f-8b4e-7081e3deb730', 'volume_name': 'volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ae2ea1-e7b2-4307-82b4-ffdee21dd049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ae2ea1-e7b2-4307-82b4-ffdee21dd049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f71c29f-b500-4401-92db-21733c8d1749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:35 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Volume e7c815c6-f7cd-4c5f-8b4e-7081e3deb730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730', 'volume_size': 1} Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:35 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1467e67d-80fc-4178-a443-3100e2db1eca 1073741824" returned: 0 in 0.742s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1467e67d-80fc-4178-a443-3100e2db1eca {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:36 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1467e67d-80fc-4178-a443-3100e2db1eca Jul 13 20:39:36 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:36 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1467e67d-80fc-4178-a443-3100e2db1eca" returned: 0 in 0.430s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:39:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.867s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-465477014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c815c6-f7cd-4c5f-8b4e-7081e3deb730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3a5d3fa6c84059969c9f47aa6bc355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:35Z,use_quota=True,user_id='35b9c20eab024637960b20672b7d93c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:39:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Creating volume e7c815c6-f7cd-4c5f-8b4e-7081e3deb730 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:39:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:39:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:39:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:39:36 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:39:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:36 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730 1073741824 Jul 13 20:39:36 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cb196f-f259-47ec-8259-27d0e441f0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1467e67d-80fc-4178-a443-3100e2db1eca', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90c0f84-8bdc-4504-9e6b-f61618ba5732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:36 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Volume volume-1467e67d-80fc-4178-a443-3100e2db1eca (1467e67d-80fc-4178-a443-3100e2db1eca): created successfully Jul 13 20:39:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90c0f84-8bdc-4504-9e6b-f61618ba5732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Flow 'volume_create_manager' (21dd7537-1d7e-4481-b10d-a9213d52eb24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:36 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8e80d224-a61b-4045-9f25-7e31a096b021 tempest-ProjectReaderTests-580912120 None] Created volume successfully. Jul 13 20:39:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] Acquiring lock "cinder-1467e67d-80fc-4178-a443-3100e2db1eca-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:39:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] Lock "cinder-1467e67d-80fc-4178-a443-3100e2db1eca-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:39:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] Acquiring lock "cinder-quobyte-1467e67d-80fc-4178-a443-3100e2db1eca" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:39:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] Lock "cinder-quobyte-1467e67d-80fc-4178-a443-3100e2db1eca" acquired by "delete_volume" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:39:37 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730 1073741824" returned: 0 in 0.788s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:37 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea0140c-d102-426a-8f1a-ecc735c9df65]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1467e67d-80fc-4178-a443-3100e2db1eca {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:37 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730 Jul 13 20:39:37 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:37 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1467e67d-80fc-4178-a443-3100e2db1eca Jul 13 20:39:37 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:37 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730" returned: 0 in 0.438s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:39:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f71c29f-b500-4401-92db-21733c8d1749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30c4263-ae25-4c42-8df4-93388d8a3964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:37 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Volume volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730 (e7c815c6-f7cd-4c5f-8b4e-7081e3deb730): created successfully Jul 13 20:39:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30c4263-ae25-4c42-8df4-93388d8a3964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Flow 'volume_create_manager' (94c8e135-2c97-43de-b61b-a5f453258b91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:37 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-835d026a-e927-46ad-86b4-040c2f9bd1e5 tempest-AttachVolumeTestJSON-290872444 None] Created volume successfully. Jul 13 20:39:38 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1467e67d-80fc-4178-a443-3100e2db1eca" returned: 0 in 0.775s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1467e67d-80fc-4178-a443-3100e2db1eca {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:38 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1467e67d-80fc-4178-a443-3100e2db1eca Jul 13 20:39:38 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:38 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1467e67d-80fc-4178-a443-3100e2db1eca" returned: 0 in 0.350s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] Lock "cinder-quobyte-1467e67d-80fc-4178-a443-3100e2db1eca" released by "delete_volume" :: held 1.195s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:39:38 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] Created reservations ['1e29a7ad-c32a-4dd0-882b-b5ce1636896e', '6b443d7a-4216-4f84-9076-b303b4aaa288', 'ad39d405-f16f-43e3-bb3a-dc832916443f', '07abc1c1-dffd-40cb-b9e8-d318ec87b144'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:39:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:39:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:39:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:38 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:39:38 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:39 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.404s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:39 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:39:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] Deleted volume successfully. Jul 13 20:39:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ebb13fd-e73e-492d-b7e3-3ea8710a984f tempest-ProjectReaderTests-580912120 None] Lock "cinder-1467e67d-80fc-4178-a443-3100e2db1eca-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:39:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-076521c8-14a0-484d-94db-ec6232091c50 req-1cba8097-f7c8-4b88-92fa-68bd690cf9cb tempest-AttachVolumeTestJSON-290872444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-076521c8-14a0-484d-94db-ec6232091c50 req-1cba8097-f7c8-4b88-92fa-68bd690cf9cb tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:40 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[496cfecd-e21d-48c3-a90c-803b531094af]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-076521c8-14a0-484d-94db-ec6232091c50 req-1cba8097-f7c8-4b88-92fa-68bd690cf9cb tempest-AttachVolumeTestJSON-290872444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:40 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730 Jul 13 20:39:40 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:40 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-076521c8-14a0-484d-94db-ec6232091c50 req-1cba8097-f7c8-4b88-92fa-68bd690cf9cb tempest-AttachVolumeTestJSON-290872444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730" returned: 0 in 0.492s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-076521c8-14a0-484d-94db-ec6232091c50 req-1cba8097-f7c8-4b88-92fa-68bd690cf9cb tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.527s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-076521c8-14a0-484d-94db-ec6232091c50 req-1cba8097-f7c8-4b88-92fa-68bd690cf9cb tempest-AttachVolumeTestJSON-290872444 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53f38319-dd30-43d4-9f07-862e0ec08a50', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:39:40 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-076521c8-14a0-484d-94db-ec6232091c50 req-1cba8097-f7c8-4b88-92fa-68bd690cf9cb tempest-AttachVolumeTestJSON-290872444 None] attachment_update completed successfully. Jul 13 20:39:42 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:39:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Flow 'volume_create_manager' (753dde2f-ef3b-4c4b-bbaf-e1ff415748bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca5c123-100a-4190-b6c1-fb10872827ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca5c123-100a-4190-b6c1-fb10872827ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1182195102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e396dbb9-3b0c-4c52-abdd-25a6bd7372fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3a5d3fa6c84059969c9f47aa6bc355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:43Z,use_quota=True,user_id='35b9c20eab024637960b20672b7d93c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a509339-c3d2-445b-8a30-876c0ee3f015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a509339-c3d2-445b-8a30-876c0ee3f015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b0b762-7dee-4488-bc87-41a8fdd5cee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b0b762-7dee-4488-bc87-41a8fdd5cee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e396dbb9-3b0c-4c52-abdd-25a6bd7372fe', 'volume_name': 'volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d225ec71-d11a-483b-9f65-b708255e5f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d225ec71-d11a-483b-9f65-b708255e5f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee9ca73-71b5-4940-90bb-f79f26bc9471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:43 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Volume e396dbb9-3b0c-4c52-abdd-25a6bd7372fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe', 'volume_size': 1} Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1182195102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e396dbb9-3b0c-4c52-abdd-25a6bd7372fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3a5d3fa6c84059969c9f47aa6bc355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:43Z,use_quota=True,user_id='35b9c20eab024637960b20672b7d93c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Creating volume e396dbb9-3b0c-4c52-abdd-25a6bd7372fe {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:39:43 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:43 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe 1073741824 Jul 13 20:39:43 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:43 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe 1073741824" returned: 0 in 0.749s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:44 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe Jul 13 20:39:44 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:44 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe" returned: 0 in 0.478s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:39:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee9ca73-71b5-4940-90bb-f79f26bc9471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b18560d-7d61-439e-9768-63ee4dbfe282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:44 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Volume volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe (e396dbb9-3b0c-4c52-abdd-25a6bd7372fe): created successfully Jul 13 20:39:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b18560d-7d61-439e-9768-63ee4dbfe282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Flow 'volume_create_manager' (753dde2f-ef3b-4c4b-bbaf-e1ff415748bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:44 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f252b4ba-49d8-422c-ac82-ba0b3fcf06e3 tempest-AttachVolumeTestJSON-290872444 None] Created volume successfully. Jul 13 20:39:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-24f780d1-cc70-4c1d-b6b8-be624046d5d7 req-963cfb5a-6f98-4897-ad96-926f9e3ceead tempest-AttachVolumeTestJSON-290872444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-24f780d1-cc70-4c1d-b6b8-be624046d5d7 req-963cfb5a-6f98-4897-ad96-926f9e3ceead tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:46 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f37a4ca-6962-4437-a568-5fba8439865b]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-24f780d1-cc70-4c1d-b6b8-be624046d5d7 req-963cfb5a-6f98-4897-ad96-926f9e3ceead tempest-AttachVolumeTestJSON-290872444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:47 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe Jul 13 20:39:47 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Flow 'volume_create_manager' (3f96e367-0dbd-423b-8637-5a409c2d2535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e486e34-e320-4f49-9b10-54aab9b0bb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e486e34-e320-4f49-9b10-54aab9b0bb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-530219459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08443d2b-562d-4b25-96f6-43f311fcdbf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b6374f553946398804f79274ce8ae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:47Z,use_quota=True,user_id='6e7cea536f9143a0b17498572330d1bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843220ac-8f68-4821-91c1-16c2a397ad4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843220ac-8f68-4821-91c1-16c2a397ad4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (154d9f5f-3b11-4922-a22f-45e18400e3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (154d9f5f-3b11-4922-a22f-45e18400e3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08443d2b-562d-4b25-96f6-43f311fcdbf4', 'volume_name': 'volume-08443d2b-562d-4b25-96f6-43f311fcdbf4', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55e4370-8ead-4ceb-bfb8-9738c77b163a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55e4370-8ead-4ceb-bfb8-9738c77b163a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29229807-dda4-4ee9-97e6-e40fb0f20b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:47 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Volume 08443d2b-562d-4b25-96f6-43f311fcdbf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08443d2b-562d-4b25-96f6-43f311fcdbf4', 'volume_size': 1} Jul 13 20:39:47 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-24f780d1-cc70-4c1d-b6b8-be624046d5d7 req-963cfb5a-6f98-4897-ad96-926f9e3ceead tempest-AttachVolumeTestJSON-290872444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe" returned: 0 in 0.917s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-24f780d1-cc70-4c1d-b6b8-be624046d5d7 req-963cfb5a-6f98-4897-ad96-926f9e3ceead tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.961s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-530219459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08443d2b-562d-4b25-96f6-43f311fcdbf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b6374f553946398804f79274ce8ae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:47Z,use_quota=True,user_id='6e7cea536f9143a0b17498572330d1bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Creating volume 08443d2b-562d-4b25-96f6-43f311fcdbf4 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:39:47 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-08443d2b-562d-4b25-96f6-43f311fcdbf4 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-24f780d1-cc70-4c1d-b6b8-be624046d5d7 req-963cfb5a-6f98-4897-ad96-926f9e3ceead tempest-AttachVolumeTestJSON-290872444 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2bbe1ad3-9c7e-4dd7-9ddd-8b64b5376095', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:39:47 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-08443d2b-562d-4b25-96f6-43f311fcdbf4 1073741824 Jul 13 20:39:47 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-24f780d1-cc70-4c1d-b6b8-be624046d5d7 req-963cfb5a-6f98-4897-ad96-926f9e3ceead tempest-AttachVolumeTestJSON-290872444 None] attachment_update completed successfully. Jul 13 20:39:48 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-08443d2b-562d-4b25-96f6-43f311fcdbf4 1073741824" returned: 0 in 1.147s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-08443d2b-562d-4b25-96f6-43f311fcdbf4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:49 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-08443d2b-562d-4b25-96f6-43f311fcdbf4 Jul 13 20:39:49 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:49 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-08443d2b-562d-4b25-96f6-43f311fcdbf4" returned: 0 in 0.540s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:39:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29229807-dda4-4ee9-97e6-e40fb0f20b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08443d2b-562d-4b25-96f6-43f311fcdbf4', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8f844e-c76c-4206-8231-9a22a4c36ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:49 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Volume volume-08443d2b-562d-4b25-96f6-43f311fcdbf4 (08443d2b-562d-4b25-96f6-43f311fcdbf4): created successfully Jul 13 20:39:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8f844e-c76c-4206-8231-9a22a4c36ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Flow 'volume_create_manager' (3f96e367-0dbd-423b-8637-5a409c2d2535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:49 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-945cbb12-c811-406d-bcc5-553b6ae22f77 tempest-ProjectReaderTests-396864284 None] Created volume successfully. Jul 13 20:39:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] Acquiring lock "cinder-08443d2b-562d-4b25-96f6-43f311fcdbf4-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:39:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] Lock "cinder-08443d2b-562d-4b25-96f6-43f311fcdbf4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:39:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] Acquiring lock "cinder-quobyte-08443d2b-562d-4b25-96f6-43f311fcdbf4" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:39:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] Lock "cinder-quobyte-08443d2b-562d-4b25-96f6-43f311fcdbf4" acquired by "delete_volume" :: waited 0.047s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:39:50 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[539e9245-c30e-4056-ba3c-a4013a979def]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-08443d2b-562d-4b25-96f6-43f311fcdbf4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:50 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-08443d2b-562d-4b25-96f6-43f311fcdbf4 Jul 13 20:39:50 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:51 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-08443d2b-562d-4b25-96f6-43f311fcdbf4" returned: 0 in 0.797s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-08443d2b-562d-4b25-96f6-43f311fcdbf4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:51 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-08443d2b-562d-4b25-96f6-43f311fcdbf4 Jul 13 20:39:51 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:51 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-08443d2b-562d-4b25-96f6-43f311fcdbf4" returned: 0 in 0.450s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] Lock "cinder-quobyte-08443d2b-562d-4b25-96f6-43f311fcdbf4" released by "delete_volume" :: held 1.350s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:39:51 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-2f792e2e-efb8-4af6-8f58-898a6b792d2f req-ce80afb3-4f01-44ae-bb38-52541bc52168 tempest-AttachVolumeTestJSON-290872444 None] Terminate volume connection completed successfully. Jul 13 20:39:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-2f792e2e-efb8-4af6-8f58-898a6b792d2f req-ce80afb3-4f01-44ae-bb38-52541bc52168 tempest-AttachVolumeTestJSON-290872444 None] Deleting attachment 53f38319-dd30-43d4-9f07-862e0ec08a50. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:39:51 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] Created reservations ['fcac2ecc-4d45-47cc-b024-1c8410424125', 'a7539079-58a3-4765-94bd-7411c4014be7', '3b81effc-e518-4bbe-841d-8bf4dfa27aff', 'a4889b15-a40f-45fc-8b70-84d9822cf72e'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:39:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:39:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:39:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:52 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:39:52 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:52 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.388s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:52 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:39:52 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] Deleted volume successfully. Jul 13 20:39:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3df45bff-1927-4735-b345-73bd35976717 tempest-ProjectReaderTests-396864284 None] Lock "cinder-08443d2b-562d-4b25-96f6-43f311fcdbf4-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:39:53 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-1d5f3565-62f2-4dc2-96b7-d7426718930c req-19ce2947-b459-4a84-b799-420454341c8d tempest-AttachVolumeTestJSON-290872444 None] Terminate volume connection completed successfully. Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-1d5f3565-62f2-4dc2-96b7-d7426718930c req-19ce2947-b459-4a84-b799-420454341c8d tempest-AttachVolumeTestJSON-290872444 None] Deleting attachment 2bbe1ad3-9c7e-4dd7-9ddd-8b64b5376095. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Flow 'volume_create_manager' (71773079-c1bb-4e9a-985d-4556163f0011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f54d64b-0d67-4a98-99c7-684318c4ffd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f54d64b-0d67-4a98-99c7-684318c4ffd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-906086355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a3c3512-0e27-4aaa-accb-53e7e14140e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b6374f553946398804f79274ce8ae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:53Z,use_quota=True,user_id='6e7cea536f9143a0b17498572330d1bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67711354-693d-427a-904e-344ca9b6caf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67711354-693d-427a-904e-344ca9b6caf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f03ae7-d346-4eca-a902-cb588602bda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f03ae7-d346-4eca-a902-cb588602bda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a3c3512-0e27-4aaa-accb-53e7e14140e9', 'volume_name': 'volume-2a3c3512-0e27-4aaa-accb-53e7e14140e9', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df16b887-6d39-4ce5-9e1e-4ddfe6721f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df16b887-6d39-4ce5-9e1e-4ddfe6721f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a55d818-e35e-4886-a8af-6f4aa1853645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:53 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Volume 2a3c3512-0e27-4aaa-accb-53e7e14140e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a3c3512-0e27-4aaa-accb-53e7e14140e9', 'volume_size': 1} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-906086355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a3c3512-0e27-4aaa-accb-53e7e14140e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b6374f553946398804f79274ce8ae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:53Z,use_quota=True,user_id='6e7cea536f9143a0b17498572330d1bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Creating volume 2a3c3512-0e27-4aaa-accb-53e7e14140e9 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:39:53 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:39:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a3c3512-0e27-4aaa-accb-53e7e14140e9 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:53 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a3c3512-0e27-4aaa-accb-53e7e14140e9 1073741824 Jul 13 20:39:53 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:54 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a3c3512-0e27-4aaa-accb-53e7e14140e9 1073741824" returned: 0 in 0.465s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a3c3512-0e27-4aaa-accb-53e7e14140e9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:54 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a3c3512-0e27-4aaa-accb-53e7e14140e9 Jul 13 20:39:54 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:54 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a3c3512-0e27-4aaa-accb-53e7e14140e9" returned: 0 in 0.249s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:39:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a55d818-e35e-4886-a8af-6f4aa1853645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a3c3512-0e27-4aaa-accb-53e7e14140e9', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581dfe7a-50c6-4a2a-b8ec-adbe272f3f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:54 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Volume volume-2a3c3512-0e27-4aaa-accb-53e7e14140e9 (2a3c3512-0e27-4aaa-accb-53e7e14140e9): created successfully Jul 13 20:39:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581dfe7a-50c6-4a2a-b8ec-adbe272f3f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Flow 'volume_create_manager' (71773079-c1bb-4e9a-985d-4556163f0011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-76fa3fe2-16b5-4d75-b83f-4db5c5d97d18 tempest-ProjectReaderTests-396864284 None] Created volume successfully. Jul 13 20:39:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] Acquiring lock "cinder-2a3c3512-0e27-4aaa-accb-53e7e14140e9-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:39:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] Lock "cinder-2a3c3512-0e27-4aaa-accb-53e7e14140e9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:39:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] Acquiring lock "cinder-quobyte-2a3c3512-0e27-4aaa-accb-53e7e14140e9" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:39:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] Lock "cinder-quobyte-2a3c3512-0e27-4aaa-accb-53e7e14140e9" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:39:55 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcb2661-b969-4e13-a7ab-5c49fb426547]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a3c3512-0e27-4aaa-accb-53e7e14140e9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:56 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a3c3512-0e27-4aaa-accb-53e7e14140e9 Jul 13 20:39:56 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:56 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a3c3512-0e27-4aaa-accb-53e7e14140e9" returned: 0 in 0.521s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a3c3512-0e27-4aaa-accb-53e7e14140e9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:56 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a3c3512-0e27-4aaa-accb-53e7e14140e9 Jul 13 20:39:56 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:56 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2a3c3512-0e27-4aaa-accb-53e7e14140e9" returned: 0 in 0.409s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] Lock "cinder-quobyte-2a3c3512-0e27-4aaa-accb-53e7e14140e9" released by "delete_volume" :: held 0.996s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:39:56 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:INSERT=24,cinder:UPDATE=84,cinder:SELECT=78,cinder:DELETE=6 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:39:56 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] Created reservations ['b7752e23-e5f0-4b98-89d7-263e6754dbb4', 'c80f3a36-dcc4-4168-b133-319ce9c90084', '8cc54bab-c8b7-43cc-9004-17e03c6e99b3', 'cf58ef36-e5ac-4cd2-9689-8997066a1182'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:39:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:39:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:39:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:57 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:39:57 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:57 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.258s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:57 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:39:57 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] Deleted volume successfully. Jul 13 20:39:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3e277a3f-6b65-48cd-8d04-d3d0ac4a9062 tempest-ProjectReaderTests-396864284 None] Lock "cinder-2a3c3512-0e27-4aaa-accb-53e7e14140e9-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Flow 'volume_create_manager' (83fdc225-694a-424c-b421-fb5fef16ed0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff63c2c-2272-4801-8fee-cefd60867872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff63c2c-2272-4801-8fee-cefd60867872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-53725544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b692eb26-db9f-40cc-aecc-c840d2315ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b6374f553946398804f79274ce8ae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:58Z,use_quota=True,user_id='6e7cea536f9143a0b17498572330d1bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a1eac4-e729-48c0-ac4f-1a6e63eb13e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a1eac4-e729-48c0-ac4f-1a6e63eb13e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c986cf-81d5-484a-b862-65cd2bc05195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c986cf-81d5-484a-b862-65cd2bc05195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b692eb26-db9f-40cc-aecc-c840d2315ed9', 'volume_name': 'volume-b692eb26-db9f-40cc-aecc-c840d2315ed9', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1fed41-c762-490b-9432-8836345b8fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1fed41-c762-490b-9432-8836345b8fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf0d28b-ae8d-4855-a7b1-0e7a8d5e806f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:58 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Volume b692eb26-db9f-40cc-aecc-c840d2315ed9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b692eb26-db9f-40cc-aecc-c840d2315ed9', 'volume_size': 1} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-53725544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b692eb26-db9f-40cc-aecc-c840d2315ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b6374f553946398804f79274ce8ae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:39:58Z,use_quota=True,user_id='6e7cea536f9143a0b17498572330d1bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Creating volume b692eb26-db9f-40cc-aecc-c840d2315ed9 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:39:58 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b692eb26-db9f-40cc-aecc-c840d2315ed9 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:58 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b692eb26-db9f-40cc-aecc-c840d2315ed9 1073741824 Jul 13 20:39:58 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] Acquiring lock "cinder-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:39:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] Lock "cinder-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] Acquiring lock "cinder-quobyte-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] Lock "cinder-quobyte-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7695c66-2d73-4b7f-bfe9-89d8e09623b3]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:59 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b692eb26-db9f-40cc-aecc-c840d2315ed9 1073741824" returned: 0 in 0.571s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:59 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe Jul 13 20:39:59 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b692eb26-db9f-40cc-aecc-c840d2315ed9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:59 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b692eb26-db9f-40cc-aecc-c840d2315ed9 Jul 13 20:39:59 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:59 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe" returned: 0 in 0.420s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:39:59 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b692eb26-db9f-40cc-aecc-c840d2315ed9" returned: 0 in 0.284s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:39:59 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe Jul 13 20:39:59 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf0d28b-ae8d-4855-a7b1-0e7a8d5e806f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b692eb26-db9f-40cc-aecc-c840d2315ed9', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72da82e-d586-4e18-8cef-cbacbbd99e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:39:59 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Volume volume-b692eb26-db9f-40cc-aecc-c840d2315ed9 (b692eb26-db9f-40cc-aecc-c840d2315ed9): created successfully Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72da82e-d586-4e18-8cef-cbacbbd99e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Flow 'volume_create_manager' (83fdc225-694a-424c-b421-fb5fef16ed0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:39:59 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f4038540-cbbb-4afb-b666-5aeb19a88b48 tempest-ProjectReaderTests-396864284 None] Created volume successfully. Jul 13 20:39:59 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe" returned: 0 in 0.297s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] Lock "cinder-quobyte-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe" released by "delete_volume" :: held 0.778s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] Created reservations ['5424a537-26e4-4622-bf45-ea385ecb5668', 'bbb0b3cd-f591-4f9e-b0c2-ff4ff2b59b56', 'caa62d74-ce87-497a-a659-729a4b49e22a', 'cc368b91-f9be-4a51-9ed1-866c141d8848'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:39:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:00 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:40:00 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] Acquiring lock "cinder-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] Lock "cinder-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] Acquiring lock "cinder-quobyte-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:00 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.334s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:40:00 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] Deleted volume successfully. Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] Lock "cinder-quobyte-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730" acquired by "delete_volume" :: waited 0.038s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[772f2c96-1b49-46b0-9379-6328e92a89c4]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7d765c3f-fb85-491d-8e0e-3ffc010325ea tempest-AttachVolumeTestJSON-290872444 None] Lock "cinder-e396dbb9-3b0c-4c52-abdd-25a6bd7372fe-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:00 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730 Jul 13 20:40:00 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] Acquiring lock "cinder-b692eb26-db9f-40cc-aecc-c840d2315ed9-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] Lock "cinder-b692eb26-db9f-40cc-aecc-c840d2315ed9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] Acquiring lock "cinder-quobyte-b692eb26-db9f-40cc-aecc-c840d2315ed9" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] Lock "cinder-quobyte-b692eb26-db9f-40cc-aecc-c840d2315ed9" acquired by "delete_volume" :: waited 0.041s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3226441-7cad-4f71-9e4f-5d54ff0a839a]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b692eb26-db9f-40cc-aecc-c840d2315ed9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:00 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730" returned: 0 in 0.521s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:00 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b692eb26-db9f-40cc-aecc-c840d2315ed9 Jul 13 20:40:00 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:00 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730 Jul 13 20:40:00 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:01 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730" returned: 0 in 0.377s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] Lock "cinder-quobyte-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730" released by "delete_volume" :: held 0.959s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:01 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b692eb26-db9f-40cc-aecc-c840d2315ed9" returned: 0 in 0.506s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b692eb26-db9f-40cc-aecc-c840d2315ed9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:01 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b692eb26-db9f-40cc-aecc-c840d2315ed9 Jul 13 20:40:01 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] Created reservations ['fd0a39b6-44ce-4219-b4b8-03b146f1f8bd', 'c1ba238d-7f7e-4171-b184-ecc821aa3764', '80d29d26-78f0-4d6f-9914-fd4f10cbb3db', '821f24f2-e3d4-438a-b549-69d3941418ea'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:01 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:40:01 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:01 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b692eb26-db9f-40cc-aecc-c840d2315ed9" returned: 0 in 0.325s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] Lock "cinder-quobyte-b692eb26-db9f-40cc-aecc-c840d2315ed9" released by "delete_volume" :: held 0.892s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] Created reservations ['1bb063fe-a08e-4b20-8593-aa99db9742fd', '99c5a3b3-a1a7-493b-823d-0dc6430b2b66', '0bf1e2fb-3507-4de1-931d-28448e9c0df6', '8662f22a-e7bc-40dd-b6f7-7b16ba652cc8'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:01 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.310s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:40:01 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] Deleted volume successfully. Jul 13 20:40:01 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:40:01 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-da838853-4014-4281-84a2-1eb507d8b0ca tempest-AttachVolumeTestJSON-290872444 None] Lock "cinder-e7c815c6-f7cd-4c5f-8b4e-7081e3deb730-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:02 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.370s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:40:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] Deleted volume successfully. Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2beadc0a-20c9-40ea-95b4-113e7839d930 tempest-ProjectReaderTests-396864284 None] Lock "cinder-b692eb26-db9f-40cc-aecc-c840d2315ed9-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Flow 'volume_create_manager' (04260949-b482-4aa2-8cfa-528ed1c94946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab6e2b2-3275-4194-99d4-72910fb7aecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=116,cinder:SELECT=100,cinder:DELETE=12,cinder:INSERT=29 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab6e2b2-3275-4194-99d4-72910fb7aecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1752728745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b6374f553946398804f79274ce8ae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:40:03Z,use_quota=True,user_id='6e7cea536f9143a0b17498572330d1bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26adac4c-3ae0-45c6-acb7-7a86cea84b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26adac4c-3ae0-45c6-acb7-7a86cea84b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8104e6a-7f45-4e6c-97be-3420581c08eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8104e6a-7f45-4e6c-97be-3420581c08eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1', 'volume_name': 'volume-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9f1daf-ed9a-4cbd-9cca-9d523b0e1a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9f1daf-ed9a-4cbd-9cca-9d523b0e1a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384798f1-294f-4885-b1df-37b6112d0d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:02 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Volume 8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1', 'volume_size': 1} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1752728745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b6374f553946398804f79274ce8ae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:40:03Z,use_quota=True,user_id='6e7cea536f9143a0b17498572330d1bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Creating volume 8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:40:02 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] Acquiring lock "cinder-f3418228-9a53-40f1-82c1-331ccb294b4b-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:02 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1 1073741824 Jul 13 20:40:02 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] Lock "cinder-f3418228-9a53-40f1-82c1-331ccb294b4b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] Acquiring lock "cinder-quobyte-f3418228-9a53-40f1-82c1-331ccb294b4b" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] Lock "cinder-quobyte-f3418228-9a53-40f1-82c1-331ccb294b4b" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c89cdb-3ae2-4662-a6ae-8ebccb99e3c8]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f3418228-9a53-40f1-82c1-331ccb294b4b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:03 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f3418228-9a53-40f1-82c1-331ccb294b4b Jul 13 20:40:03 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:03 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1 1073741824" returned: 0 in 0.535s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:03 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f3418228-9a53-40f1-82c1-331ccb294b4b" returned: 0 in 0.398s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f3418228-9a53-40f1-82c1-331ccb294b4b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:03 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f3418228-9a53-40f1-82c1-331ccb294b4b Jul 13 20:40:03 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:03 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1 Jul 13 20:40:03 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:03 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f3418228-9a53-40f1-82c1-331ccb294b4b" returned: 0 in 0.304s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] Lock "cinder-quobyte-f3418228-9a53-40f1-82c1-331ccb294b4b" released by "delete_volume" :: held 0.755s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:03 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1" returned: 0 in 0.302s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384798f1-294f-4885-b1df-37b6112d0d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ea6a5a-85e0-4266-9612-635d0b1941be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:03 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Volume volume-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1 (8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1): created successfully Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ea6a5a-85e0-4266-9612-635d0b1941be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Flow 'volume_create_manager' (04260949-b482-4aa2-8cfa-528ed1c94946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] Created reservations ['3698ba15-b179-40de-b408-51c689fdccda', 'b05e7df7-4237-4313-8b3d-8c80312fcc88', '475e5cc9-1e5a-46d2-bb8d-34f57918f022', '264fc0f2-134e-43a0-a092-288e58b3a1fd'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:40:03 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-697e7a1f-2899-4242-a6dd-7b4cd2f35dd8 tempest-ProjectReaderTests-396864284 None] Created volume successfully. Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:04 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:40:04 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:04 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.362s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:04 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:40:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] Deleted volume successfully. Jul 13 20:40:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ccb8795-a29c-420e-a2d0-ab0ac56777ef tempest-AttachVolumeTestJSON-290872444 None] Lock "cinder-f3418228-9a53-40f1-82c1-331ccb294b4b-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] Acquiring lock "cinder-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] Lock "cinder-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] Acquiring lock "cinder-quobyte-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] Lock "cinder-quobyte-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1" acquired by "delete_volume" :: waited 0.040s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:04 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e268aa03-df18-4856-ac5c-194f42783884]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:40:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-8bddda42-702c-45b9-9e04-664988129a9f req-28a5e4bd-db3a-4cba-a68c-3be1ee0225ed tempest-TestInstancesWithCinderVolumes-1133704955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-8bddda42-702c-45b9-9e04-664988129a9f req-28a5e4bd-db3a-4cba-a68c-3be1ee0225ed tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8122b421-ae9a-435c-a27a-726837d5a6c0]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:40:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-8bddda42-702c-45b9-9e04-664988129a9f req-28a5e4bd-db3a-4cba-a68c-3be1ee0225ed tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:05 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1 Jul 13 20:40:05 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:05 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51 Jul 13 20:40:05 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:05 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1" returned: 0 in 0.523s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:05 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1 Jul 13 20:40:05 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:05 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-8bddda42-702c-45b9-9e04-664988129a9f req-28a5e4bd-db3a-4cba-a68c-3be1ee0225ed tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51" returned: 0 in 0.495s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-8bddda42-702c-45b9-9e04-664988129a9f req-28a5e4bd-db3a-4cba-a68c-3be1ee0225ed tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.519s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-8bddda42-702c-45b9-9e04-664988129a9f req-28a5e4bd-db3a-4cba-a68c-3be1ee0225ed tempest-TestInstancesWithCinderVolumes-1133704955 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92f72f7e-0168-4916-a7c8-d2c1deefbf3d', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:40:05 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1" returned: 0 in 0.343s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] Lock "cinder-quobyte-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1" released by "delete_volume" :: held 0.924s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-8bddda42-702c-45b9-9e04-664988129a9f req-28a5e4bd-db3a-4cba-a68c-3be1ee0225ed tempest-TestInstancesWithCinderVolumes-1133704955 None] attachment_update completed successfully. Jul 13 20:40:05 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] Created reservations ['c5c3b017-2648-49af-a152-affdc399d030', '51332580-cc68-4d25-bf39-1033cdb0697e', '759cc51f-84fe-4e58-899e-148c6622002c', '9ee9d71f-1bcf-40f9-8814-a6e9495c2fd5'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:40:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:40:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:40:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:06 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:40:06 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:06 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.504s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:06 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:40:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] Deleted volume successfully. Jul 13 20:40:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a39ae1db-bee1-48a1-8be6-4a82aec0827a tempest-ProjectReaderTests-396864284 None] Lock "cinder-8c39e28d-f2e5-4fd9-8ba3-59a90c4d3ce1-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-2a71d548-c8da-4297-a13f-a8667986cf8b req-b8f5d134-f77f-4f2a-87d3-e96f29e4670c tempest-TestInstancesWithCinderVolumes-1133704955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-2a71d548-c8da-4297-a13f-a8667986cf8b req-b8f5d134-f77f-4f2a-87d3-e96f29e4670c tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:08 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a05d84-039f-4060-a915-047f96029daa]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:40:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-2a71d548-c8da-4297-a13f-a8667986cf8b req-b8f5d134-f77f-4f2a-87d3-e96f29e4670c tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ef54f9b0-4204-4443-85fa-7dbb704612f8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:08 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ef54f9b0-4204-4443-85fa-7dbb704612f8 Jul 13 20:40:08 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:08 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-2a71d548-c8da-4297-a13f-a8667986cf8b req-b8f5d134-f77f-4f2a-87d3-e96f29e4670c tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ef54f9b0-4204-4443-85fa-7dbb704612f8" returned: 0 in 0.522s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-2a71d548-c8da-4297-a13f-a8667986cf8b req-b8f5d134-f77f-4f2a-87d3-e96f29e4670c tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.559s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-2a71d548-c8da-4297-a13f-a8667986cf8b req-b8f5d134-f77f-4f2a-87d3-e96f29e4670c tempest-TestInstancesWithCinderVolumes-1133704955 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-ef54f9b0-4204-4443-85fa-7dbb704612f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb5a5870-bb76-4f7e-b685-f375b1425d58', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:40:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-2a71d548-c8da-4297-a13f-a8667986cf8b req-b8f5d134-f77f-4f2a-87d3-e96f29e4670c tempest-TestInstancesWithCinderVolumes-1133704955 None] attachment_update completed successfully. Jul 13 20:40:14 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:40:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Flow 'volume_create_manager' (eb4a617f-bca5-432f-88a9-fdfc46e30d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:40:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a911019-61ed-48a0-b103-2e8c7bc2449e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a911019-61ed-48a0-b103-2e8c7bc2449e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1036307779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba613ba-e473-41e4-b7db-05269a3096c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6b1436bbd942328b2436c5b4fa3aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:40:14Z,use_quota=True,user_id='e9f9294ba8c045748c04ee5dee219ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d6aa27-ba8f-452e-bfc1-4f6d91317ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d6aa27-ba8f-452e-bfc1-4f6d91317ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d766e29-59c6-44bd-9ae4-28cfeb4889e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:14 devstack cinder-volume[87269]: DEBUG cinder.image.glance [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Creating Keystone auth plugin from conf {{(pid=87269) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 13 20:40:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d766e29-59c6-44bd-9ae4-28cfeb4889e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eba613ba-e473-41e4-b7db-05269a3096c4', 'volume_name': 'volume-eba613ba-e473-41e4-b7db-05269a3096c4', 'volume_size': 1, 'image_id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6b4015e3a3db4a91ba2712f5d9c0002b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'created_at': datetime.datetime(2026, 7, 13, 18, 22, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5c85faa-ccd2-446c-ac1c-c871b5183834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e283a52-f49a-4f98-bf5e-388aeb126203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e283a52-f49a-4f98-bf5e-388aeb126203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13b6370-d7a1-47ca-ac12-fba7fe1d0cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:14 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Volume eba613ba-e473-41e4-b7db-05269a3096c4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eba613ba-e473-41e4-b7db-05269a3096c4', 'volume_size': 1, 'image_id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6b4015e3a3db4a91ba2712f5d9c0002b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'created_at': datetime.datetime(2026, 7, 13, 18, 22, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5c85faa-ccd2-446c-ac1c-c871b5183834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 13 20:40:14 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Trying to clone eba613ba-e473-41e4-b7db-05269a3096c4 from image a5c85faa-ccd2-446c-ac1c-c871b5183834 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}]). {{(pid=87269) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 13 20:40:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-086dfa54-3862-4a9d-97b6-7b2ae008f819 req-7dadd871-3dc0-4b1c-b01e-61fa7be26d93 tempest-TestInstancesWithCinderVolumes-1133704955 None] Terminate volume connection completed successfully. Jul 13 20:40:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-086dfa54-3862-4a9d-97b6-7b2ae008f819 req-7dadd871-3dc0-4b1c-b01e-61fa7be26d93 tempest-TestInstancesWithCinderVolumes-1133704955 None] Deleting attachment 92f72f7e-0168-4916-a7c8-d2c1deefbf3d. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:40:15 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_ywp1lljldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 13 20:40:15 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Image download 20.69 MB at 20.69 MB/s Jul 13 20:40:15 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6363783-47b5-4a6a-b0fc-84376851df26]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:40:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_ywp1lljldevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:15 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_ywp1lljldevstack@QuobyteHD Jul 13 20:40:15 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:15 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_ywp1lljldevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:15 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Temporary image a5c85faa-ccd2-446c-ac1c-c871b5183834 is fetched for user e9f9294ba8c045748c04ee5dee219ebd. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 13 20:40:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] Acquiring lock "cinder-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "cinder-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:15 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[504814a2-49c6-4999-b0d5-70ff883388ef]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:40:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_ywp1lljldevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] Acquiring lock "cinder-quobyte-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "cinder-quobyte-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:15 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9b703d-656b-4209-8497-eddb38d7cbca]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:40:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:15 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_ywp1lljldevstack@QuobyteHD Jul 13 20:40:15 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:16 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51 Jul 13 20:40:16 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:16 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_ywp1lljldevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1036307779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba613ba-e473-41e4-b7db-05269a3096c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6b1436bbd942328b2436c5b4fa3aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:40:14Z,use_quota=True,user_id='e9f9294ba8c045748c04ee5dee219ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Creating volume eba613ba-e473-41e4-b7db-05269a3096c4 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:40:16 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:16 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 1073741824 Jul 13 20:40:16 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:16 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51" returned: 0 in 0.450s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:16 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51 Jul 13 20:40:16 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:16 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51" returned: 0 in 0.340s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "cinder-quobyte-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51" released by "delete_volume" :: held 0.855s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:16 devstack cinder-volume[87269]: WARNING cinder.quota [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-294086918-1077454480 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-294086918-1077454480, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:40:16 devstack cinder-volume[87269]: WARNING cinder.quota [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-294086918-1077454480 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-294086918-1077454480, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:40:16 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 1073741824" returned: 0 in 0.556s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] Created reservations ['d0385ef1-056c-40a2-8a8a-c4ab1c78ebc2', 'e1bc463b-3157-4f4f-94a9-0fdbf5fa0d1f', '44f7d2b5-5074-42cd-9a1c-45e86f084f2e', 'cef806d2-6b53-4381-913e-1b7e828cf98f'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:16 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 Jul 13 20:40:16 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:16 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:40:16 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:17 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4" returned: 0 in 0.338s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:40:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:17 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Attempting download of a5c85faa-ccd2-446c-ac1c-c871b5183834 ((None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}])) to volume eba613ba-e473-41e4-b7db-05269a3096c4. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 13 20:40:17 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.338s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:17 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:40:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] Deleted volume successfully. Jul 13 20:40:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f95d1e90-1a9c-4ea1-9f8e-416138d62215 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "cinder-b8966a65-d6c8-401f-8bb7-2f3e4cedfb51-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:17 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d2a059-ea16-4f28-b316-13a468d26c72]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:40:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_zquy2kdh {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:17 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_zquy2kdh Jul 13 20:40:17 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:17 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_zquy2kdh" returned: 0 in 0.392s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_zquy2kdh {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:17 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_zquy2kdh Jul 13 20:40:17 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:18 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_zquy2kdh" returned: 1 in 0.349s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5c85faa-ccd2-446c-ac1c-c871b5183834_zquy2kdh' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:40:18 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[302eb156-1abd-413d-bbfe-f0449595e1a4]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:40:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_ywp1lljldevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:18 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_ywp1lljldevstack@QuobyteHD Jul 13 20:40:18 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:18 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_ywp1lljldevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:18 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] a5c85faa-ccd2-446c-ac1c-c871b5183834 was qcow2, converting to raw {{(pid=87269) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 13 20:40:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_ywp1lljldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:18 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_ywp1lljldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 Jul 13 20:40:18 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:40:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:40:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:40:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:18 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:40:18 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:19 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.273s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:40:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:40:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:40:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:40:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-496c5913-c1ff-491a-9f13-40ed1ff03d8b req-53b98187-b304-4930-864b-bb96d1d15f7e tempest-TestInstancesWithCinderVolumes-1133704955 None] Terminate volume connection completed successfully. Jul 13 20:40:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-496c5913-c1ff-491a-9f13-40ed1ff03d8b req-53b98187-b304-4930-864b-bb96d1d15f7e tempest-TestInstancesWithCinderVolumes-1133704955 None] Deleting attachment eb5a5870-bb76-4f7e-b685-f375b1425d58. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:40:20 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_ywp1lljldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4" returned: 0 in 1.948s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:20 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5c85faa-ccd2-446c-ac1c-c871b5183834_ywp1lljldevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:40:20 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Converted 112.00 MB image at 57.45 MB/s Jul 13 20:40:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:20 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 1G Jul 13 20:40:20 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:20 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 1G" returned: 0 in 0.344s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9fda67-1b04-48cf-a5e1-a58fc3c177ca]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:40:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] Acquiring lock "cinder-ef54f9b0-4204-4443-85fa-7dbb704612f8-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "cinder-ef54f9b0-4204-4443-85fa-7dbb704612f8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] Acquiring lock "cinder-quobyte-ef54f9b0-4204-4443-85fa-7dbb704612f8" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "cinder-quobyte-ef54f9b0-4204-4443-85fa-7dbb704612f8" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:21 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 Jul 13 20:40:21 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a5046c-4404-4686-9dbb-1b22636780e0]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:40:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ef54f9b0-4204-4443-85fa-7dbb704612f8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:21 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ef54f9b0-4204-4443-85fa-7dbb704612f8 Jul 13 20:40:21 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:21 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4" returned: 0 in 0.579s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:21 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 Jul 13 20:40:21 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:21 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ef54f9b0-4204-4443-85fa-7dbb704612f8" returned: 0 in 0.607s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ef54f9b0-4204-4443-85fa-7dbb704612f8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:21 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ef54f9b0-4204-4443-85fa-7dbb704612f8 Jul 13 20:40:21 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:21 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4" returned: 1 in 0.575s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:40:21 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Downloaded image a5c85faa-ccd2-446c-ac1c-c871b5183834 ((None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}])) to volume eba613ba-e473-41e4-b7db-05269a3096c4 successfully. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 13 20:40:22 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Temporary image a5c85faa-ccd2-446c-ac1c-c871b5183834 for user e9f9294ba8c045748c04ee5dee219ebd is deleted. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Marking volume eba613ba-e473-41e4-b7db-05269a3096c4 as bootable. {{(pid=87269) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ef54f9b0-4204-4443-85fa-7dbb704612f8" returned: 0 in 0.349s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "cinder-quobyte-ef54f9b0-4204-4443-85fa-7dbb704612f8" released by "delete_volume" :: held 1.020s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Copying metadata from image a5c85faa-ccd2-446c-ac1c-c871b5183834 to eba613ba-e473-41e4-b7db-05269a3096c4. {{(pid=87269) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Creating volume glance metadata for volume eba613ba-e473-41e4-b7db-05269a3096c4 backed by image a5c85faa-ccd2-446c-ac1c-c871b5183834 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87269) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 13 20:40:22 devstack cinder-volume[87269]: WARNING cinder.quota [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2094882789-747245165 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2094882789-747245165, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:40:22 devstack cinder-volume[87269]: WARNING cinder.quota [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2094882789-747245165 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2094882789-747245165, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] Created reservations ['0a8dfd98-f785-4f14-82df-e4e624f04814', '94421535-1d50-429e-bc9e-434adbe2f179', 'b114d172-b3f5-4f41-9873-7c9e1c935bea', '326dddab-a08e-4858-ac40-281c1f90cd7f'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13b6370-d7a1-47ca-ac12-fba7fe1d0cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eba613ba-e473-41e4-b7db-05269a3096c4', 'volume_size': 1, 'image_id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5c85faa-ccd2-446c-ac1c-c871b5183834', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6b4015e3a3db4a91ba2712f5d9c0002b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5c85faa-ccd2-446c-ac1c-c871b5183834', 'created_at': datetime.datetime(2026, 7, 13, 18, 22, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5c85faa-ccd2-446c-ac1c-c871b5183834/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e88b74-3b66-4797-88ab-3329cab9affb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:22 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Volume volume-eba613ba-e473-41e4-b7db-05269a3096c4 (eba613ba-e473-41e4-b7db-05269a3096c4): created successfully Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e88b74-3b66-4797-88ab-3329cab9affb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Flow 'volume_create_manager' (eb4a617f-bca5-432f-88a9-fdfc46e30d0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:40:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-88d27240-0e3b-449f-b67e-e8b237cfc615 tempest-TestShelveInstance-2082562858 None] Created volume successfully. Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:22 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:40:22 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:22 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.296s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:40:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] Deleted volume successfully. Jul 13 20:40:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-673083e9-6f5c-49fa-bec1-64be324cad91 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "cinder-ef54f9b0-4204-4443-85fa-7dbb704612f8-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-60eabc6a-177e-4ef4-aae1-7fbf383af591 req-4b8a3944-f395-4f18-94b3-85036192e491 tempest-TestShelveInstance-2082562858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-60eabc6a-177e-4ef4-aae1-7fbf383af591 req-4b8a3944-f395-4f18-94b3-85036192e491 tempest-TestShelveInstance-2082562858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:28 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3c5a6f-7234-43d7-ab52-92c473b22e5e]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:40:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-60eabc6a-177e-4ef4-aae1-7fbf383af591 req-4b8a3944-f395-4f18-94b3-85036192e491 tempest-TestShelveInstance-2082562858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:28 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 Jul 13 20:40:28 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-e8ee966e-4eb7-458e-9380-e5169306f8cf req-ddbc6eb2-0c12-4c09-aa96-ba4612be37d8 tempest-TestInstancesWithCinderVolumes-1133704955 None] Terminate volume connection completed successfully. Jul 13 20:40:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-e8ee966e-4eb7-458e-9380-e5169306f8cf req-ddbc6eb2-0c12-4c09-aa96-ba4612be37d8 tempest-TestInstancesWithCinderVolumes-1133704955 None] Deleting attachment 8d70db71-5728-4e55-8ed1-4dbd12633d99. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:40:28 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-60eabc6a-177e-4ef4-aae1-7fbf383af591 req-4b8a3944-f395-4f18-94b3-85036192e491 tempest-TestShelveInstance-2082562858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4" returned: 0 in 0.465s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-60eabc6a-177e-4ef4-aae1-7fbf383af591 req-4b8a3944-f395-4f18-94b3-85036192e491 tempest-TestShelveInstance-2082562858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:28 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 Jul 13 20:40:28 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:29 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-60eabc6a-177e-4ef4-aae1-7fbf383af591 req-4b8a3944-f395-4f18-94b3-85036192e491 tempest-TestShelveInstance-2082562858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4" returned: 1 in 0.411s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-60eabc6a-177e-4ef4-aae1-7fbf383af591 req-4b8a3944-f395-4f18-94b3-85036192e491 tempest-TestShelveInstance-2082562858 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:40:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-60eabc6a-177e-4ef4-aae1-7fbf383af591 req-4b8a3944-f395-4f18-94b3-85036192e491 tempest-TestShelveInstance-2082562858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.955s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-60eabc6a-177e-4ef4-aae1-7fbf383af591 req-4b8a3944-f395-4f18-94b3-85036192e491 tempest-TestShelveInstance-2082562858 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-eba613ba-e473-41e4-b7db-05269a3096c4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '006561f4-e7d8-458b-be9c-59e00e59f88f', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:40:29 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-60eabc6a-177e-4ef4-aae1-7fbf383af591 req-4b8a3944-f395-4f18-94b3-85036192e491 tempest-TestShelveInstance-2082562858 None] attachment_update completed successfully. Jul 13 20:40:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Acquiring lock "cinder-118e913c-289e-47f7-866e-65de85b35564-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "cinder-118e913c-289e-47f7-866e-65de85b35564-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Acquiring lock "cinder-quobyte-118e913c-289e-47f7-866e-65de85b35564" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "cinder-quobyte-118e913c-289e-47f7-866e-65de85b35564" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:29 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[476c3150-3e9d-4ab7-bb34-d74df8f9ddd4]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:40:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:30 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 Jul 13 20:40:30 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:30 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564" returned: 0 in 0.467s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:30 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 Jul 13 20:40:30 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:30 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564" returned: 1 in 0.408s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:40:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:30 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564 Jul 13 20:40:30 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:31 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-118e913c-289e-47f7-866e-65de85b35564" returned: 0 in 0.356s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "cinder-quobyte-118e913c-289e-47f7-866e-65de85b35564" released by "delete_volume" :: held 1.344s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:31 devstack cinder-volume[87269]: WARNING cinder.quota [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1971604951-962272817 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1971604951-962272817, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:40:31 devstack cinder-volume[87269]: WARNING cinder.quota [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1971604951-962272817 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1971604951-962272817, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:40:31 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Created reservations ['91b38377-78ec-4f16-9425-dde5d140d252', 'a2473ed2-bd82-40de-a4ee-0d89ab8dbeeb', '41dc1423-2d0d-42c0-88f0-f1c56c7cbd09', '5718a665-74ad-44ff-b309-74611a202c34'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:40:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:40:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:40:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:31 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:40:31 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:31 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.367s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:31 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:40:31 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Deleted volume successfully. Jul 13 20:40:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-22a35f05-267f-4cb3-b748-0833abc17ed6 tempest-TestInstancesWithCinderVolumes-1133704955 None] Lock "cinder-118e913c-289e-47f7-866e-65de85b35564-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:41 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=51,cinder:UPDATE=57,cinder:INSERT=15,cinder:DELETE=2 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:40:41 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:INSERT=29,cinder:UPDATE=84,cinder:SELECT=77,cinder:DELETE=8 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Flow 'volume_create_manager' (bc09f8f1-46de-4dcb-8931-1a3c44845b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c959dad0-c8b6-423b-b743-bd843478bd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c959dad0-c8b6-423b-b743-bd843478bd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1485271162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8270c136-178f-4fe9-84d0-02a48cc12dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0970414db9e34a52b40c967a9076da9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:40:50Z,use_quota=True,user_id='0b4de5b0b1344a8d86a39d80cf9728fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ac6fbe-1b06-4e7e-8ebb-d49637b032a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ac6fbe-1b06-4e7e-8ebb-d49637b032a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b043283f-6613-49c9-a980-42d5cbfd1f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b043283f-6613-49c9-a980-42d5cbfd1f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8270c136-178f-4fe9-84d0-02a48cc12dce', 'volume_name': 'volume-8270c136-178f-4fe9-84d0-02a48cc12dce', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d26086e-bd55-4b85-b3aa-914f58d8b19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d26086e-bd55-4b85-b3aa-914f58d8b19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5839d95f-6dd5-4d12-8d89-2ad7b632f86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:50 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Volume 8270c136-178f-4fe9-84d0-02a48cc12dce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8270c136-178f-4fe9-84d0-02a48cc12dce', 'volume_size': 1} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1485271162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8270c136-178f-4fe9-84d0-02a48cc12dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0970414db9e34a52b40c967a9076da9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:40:50Z,use_quota=True,user_id='0b4de5b0b1344a8d86a39d80cf9728fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Creating volume 8270c136-178f-4fe9-84d0-02a48cc12dce {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:40:50 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8270c136-178f-4fe9-84d0-02a48cc12dce 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:50 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8270c136-178f-4fe9-84d0-02a48cc12dce 1073741824 Jul 13 20:40:50 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Flow 'volume_create_manager' (a521c40c-725f-42a6-8d55-bd841032ccf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:40:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f66bf9b-c2dc-423d-9d26-032620640ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f66bf9b-c2dc-423d-9d26-032620640ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1719610243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501ddbfd-c027-487e-99a6-434919f31146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0970414db9e34a52b40c967a9076da9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:40:51Z,use_quota=True,user_id='0b4de5b0b1344a8d86a39d80cf9728fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f3e0f3-0466-4d9f-9bb7-1205b174a79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f3e0f3-0466-4d9f-9bb7-1205b174a79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc069d2-b524-4290-a568-927de701cf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc069d2-b524-4290-a568-927de701cf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '501ddbfd-c027-487e-99a6-434919f31146', 'volume_name': 'volume-501ddbfd-c027-487e-99a6-434919f31146', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67759e1f-2b7a-4a1c-a798-16ecc004f585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67759e1f-2b7a-4a1c-a798-16ecc004f585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147ce8af-b124-4c39-9bae-ac57b869e67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:51 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Volume 501ddbfd-c027-487e-99a6-434919f31146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-501ddbfd-c027-487e-99a6-434919f31146', 'volume_size': 1} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:51 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8270c136-178f-4fe9-84d0-02a48cc12dce 1073741824" returned: 0 in 0.776s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8270c136-178f-4fe9-84d0-02a48cc12dce {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:51 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8270c136-178f-4fe9-84d0-02a48cc12dce Jul 13 20:40:51 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Flow 'volume_create_manager' (7c40aca6-d55f-4cd8-afdd-b1677eb14254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12dbbbb1-8a86-43e2-b8eb-6c1e4e992ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12dbbbb1-8a86-43e2-b8eb-6c1e4e992ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1377330216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5291c3a6-1b27-4ba3-9ef5-a69899c1742d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0970414db9e34a52b40c967a9076da9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:40:51Z,use_quota=True,user_id='0b4de5b0b1344a8d86a39d80cf9728fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43ea8f9-89e3-4993-a191-94c2e26aa856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43ea8f9-89e3-4993-a191-94c2e26aa856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2edb805-5a51-4f44-9963-a6e5bb920f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2edb805-5a51-4f44-9963-a6e5bb920f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5291c3a6-1b27-4ba3-9ef5-a69899c1742d', 'volume_name': 'volume-5291c3a6-1b27-4ba3-9ef5-a69899c1742d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8d0279-8947-4540-8d3f-d52e468b3ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8d0279-8947-4540-8d3f-d52e468b3ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32925569-cf5d-4659-9038-ec2b80e360aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:51 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Volume 5291c3a6-1b27-4ba3-9ef5-a69899c1742d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5291c3a6-1b27-4ba3-9ef5-a69899c1742d', 'volume_size': 1} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:51 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8270c136-178f-4fe9-84d0-02a48cc12dce" returned: 0 in 0.521s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.829s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1719610243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501ddbfd-c027-487e-99a6-434919f31146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0970414db9e34a52b40c967a9076da9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:40:51Z,use_quota=True,user_id='0b4de5b0b1344a8d86a39d80cf9728fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Creating volume 501ddbfd-c027-487e-99a6-434919f31146 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:40:51 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:40:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501ddbfd-c027-487e-99a6-434919f31146 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:52 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501ddbfd-c027-487e-99a6-434919f31146 1073741824 Jul 13 20:40:52 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5839d95f-6dd5-4d12-8d89-2ad7b632f86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8270c136-178f-4fe9-84d0-02a48cc12dce', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf155145-e393-40fc-a472-c5e0635a4be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:52 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Volume volume-8270c136-178f-4fe9-84d0-02a48cc12dce (8270c136-178f-4fe9-84d0-02a48cc12dce): created successfully Jul 13 20:40:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf155145-e393-40fc-a472-c5e0635a4be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Flow 'volume_create_manager' (bc09f8f1-46de-4dcb-8931-1a3c44845b73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:40:52 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-47608be0-6482-4f1e-9649-1cf2f052467c tempest-CreateVolumesFromImageTest-891995824 None] Created volume successfully. Jul 13 20:40:52 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:40:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Flow 'volume_create_manager' (eb9b7593-ebe6-4088-80c1-2443ac57752c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:40:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c43d9c9-8c00-4a68-8a8b-ba96ee94bc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c43d9c9-8c00-4a68-8a8b-ba96ee94bc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1487628176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eb20aeb-e851-453a-8cf2-d4f54be48c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0970414db9e34a52b40c967a9076da9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:40:52Z,use_quota=True,user_id='0b4de5b0b1344a8d86a39d80cf9728fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5159f9a0-82db-4c62-b835-32f231fad57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5159f9a0-82db-4c62-b835-32f231fad57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3942d925-ca47-4535-bbc5-b9b64edc3290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3942d925-ca47-4535-bbc5-b9b64edc3290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eb20aeb-e851-453a-8cf2-d4f54be48c7e', 'volume_name': 'volume-0eb20aeb-e851-453a-8cf2-d4f54be48c7e', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8b53ba-f7db-4c95-b790-a4543797e378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8b53ba-f7db-4c95-b790-a4543797e378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0afb5f-1f76-4dd0-90dc-e98503bb245e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:52 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Volume 0eb20aeb-e851-453a-8cf2-d4f54be48c7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eb20aeb-e851-453a-8cf2-d4f54be48c7e', 'volume_size': 1} Jul 13 20:40:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:52 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501ddbfd-c027-487e-99a6-434919f31146 1073741824" returned: 0 in 0.939s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501ddbfd-c027-487e-99a6-434919f31146 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:52 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501ddbfd-c027-487e-99a6-434919f31146 Jul 13 20:40:52 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:52 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Flow 'volume_create_manager' (421fbda9-cbb6-4105-a492-9ca9c7964ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1150812b-a747-4982-878d-4823f4ed370e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1150812b-a747-4982-878d-4823f4ed370e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-678609754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93273fc-0d70-480f-b5cf-073c04c4b6df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0970414db9e34a52b40c967a9076da9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:40:53Z,use_quota=True,user_id='0b4de5b0b1344a8d86a39d80cf9728fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c71acd1-1b85-4646-8036-d98c7e9b178a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c71acd1-1b85-4646-8036-d98c7e9b178a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ab336b-1f38-4df3-abad-1d2f620b9467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ab336b-1f38-4df3-abad-1d2f620b9467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c93273fc-0d70-480f-b5cf-073c04c4b6df', 'volume_name': 'volume-c93273fc-0d70-480f-b5cf-073c04c4b6df', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a6f41c-fa24-4d8a-b0b8-05ce543758d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a6f41c-fa24-4d8a-b0b8-05ce543758d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f8f041-0aed-476d-af74-c75ca5dade98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:53 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Volume c93273fc-0d70-480f-b5cf-073c04c4b6df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c93273fc-0d70-480f-b5cf-073c04c4b6df', 'volume_size': 1} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:53 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501ddbfd-c027-487e-99a6-434919f31146" returned: 0 in 0.307s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.574s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1377330216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5291c3a6-1b27-4ba3-9ef5-a69899c1742d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0970414db9e34a52b40c967a9076da9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:40:51Z,use_quota=True,user_id='0b4de5b0b1344a8d86a39d80cf9728fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Creating volume 5291c3a6-1b27-4ba3-9ef5-a69899c1742d {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:40:53 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5291c3a6-1b27-4ba3-9ef5-a69899c1742d 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147ce8af-b124-4c39-9bae-ac57b869e67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-501ddbfd-c027-487e-99a6-434919f31146', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:53 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5291c3a6-1b27-4ba3-9ef5-a69899c1742d 1073741824 Jul 13 20:40:53 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9080a3f7-f7d6-44d3-a6d5-d7796db72d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:53 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Volume volume-501ddbfd-c027-487e-99a6-434919f31146 (501ddbfd-c027-487e-99a6-434919f31146): created successfully Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9080a3f7-f7d6-44d3-a6d5-d7796db72d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Flow 'volume_create_manager' (a521c40c-725f-42a6-8d55-bd841032ccf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:40:53 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f384c787-ebc0-4864-b561-a5f28798997e tempest-CreateVolumesFromImageTest-891995824 None] Created volume successfully. Jul 13 20:40:53 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5291c3a6-1b27-4ba3-9ef5-a69899c1742d 1073741824" returned: 0 in 0.414s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5291c3a6-1b27-4ba3-9ef5-a69899c1742d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:53 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5291c3a6-1b27-4ba3-9ef5-a69899c1742d Jul 13 20:40:53 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:53 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5291c3a6-1b27-4ba3-9ef5-a69899c1742d" returned: 0 in 0.258s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.366s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1487628176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eb20aeb-e851-453a-8cf2-d4f54be48c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0970414db9e34a52b40c967a9076da9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:40:52Z,use_quota=True,user_id='0b4de5b0b1344a8d86a39d80cf9728fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Creating volume 0eb20aeb-e851-453a-8cf2-d4f54be48c7e {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:40:53 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:40:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0eb20aeb-e851-453a-8cf2-d4f54be48c7e 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32925569-cf5d-4659-9038-ec2b80e360aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5291c3a6-1b27-4ba3-9ef5-a69899c1742d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe10019-9cbf-4d1c-821c-aaf2f9749f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:54 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0eb20aeb-e851-453a-8cf2-d4f54be48c7e 1073741824 Jul 13 20:40:54 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:54 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Volume volume-5291c3a6-1b27-4ba3-9ef5-a69899c1742d (5291c3a6-1b27-4ba3-9ef5-a69899c1742d): created successfully Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe10019-9cbf-4d1c-821c-aaf2f9749f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Flow 'volume_create_manager' (7c40aca6-d55f-4cd8-afdd-b1677eb14254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:40:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3c12820a-b54e-44f7-96ac-86aeff8c825a tempest-CreateVolumesFromImageTest-891995824 None] Created volume successfully. Jul 13 20:40:54 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0eb20aeb-e851-453a-8cf2-d4f54be48c7e 1073741824" returned: 0 in 0.411s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0eb20aeb-e851-453a-8cf2-d4f54be48c7e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:54 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0eb20aeb-e851-453a-8cf2-d4f54be48c7e Jul 13 20:40:54 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:54 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0eb20aeb-e851-453a-8cf2-d4f54be48c7e" returned: 0 in 0.258s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.564s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-678609754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93273fc-0d70-480f-b5cf-073c04c4b6df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0970414db9e34a52b40c967a9076da9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:40:53Z,use_quota=True,user_id='0b4de5b0b1344a8d86a39d80cf9728fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Creating volume c93273fc-0d70-480f-b5cf-073c04c4b6df {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:40:54 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c93273fc-0d70-480f-b5cf-073c04c4b6df 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:54 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c93273fc-0d70-480f-b5cf-073c04c4b6df 1073741824 Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0afb5f-1f76-4dd0-90dc-e98503bb245e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eb20aeb-e851-453a-8cf2-d4f54be48c7e', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:54 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0e0077-9201-4a85-8c0d-0ff11bd73fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:54 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Volume volume-0eb20aeb-e851-453a-8cf2-d4f54be48c7e (0eb20aeb-e851-453a-8cf2-d4f54be48c7e): created successfully Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0e0077-9201-4a85-8c0d-0ff11bd73fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Flow 'volume_create_manager' (eb9b7593-ebe6-4088-80c1-2443ac57752c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:40:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-acba84c3-70ea-48d7-83fe-381304332a38 tempest-CreateVolumesFromImageTest-891995824 None] Created volume successfully. Jul 13 20:40:55 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c93273fc-0d70-480f-b5cf-073c04c4b6df 1073741824" returned: 0 in 0.438s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c93273fc-0d70-480f-b5cf-073c04c4b6df {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:55 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c93273fc-0d70-480f-b5cf-073c04c4b6df Jul 13 20:40:55 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:55 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c93273fc-0d70-480f-b5cf-073c04c4b6df" returned: 0 in 0.239s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:40:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f8f041-0aed-476d-af74-c75ca5dade98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c93273fc-0d70-480f-b5cf-073c04c4b6df', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3c1832-22d3-4738-bbb4-d9c08fa684ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:40:55 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Volume volume-c93273fc-0d70-480f-b5cf-073c04c4b6df (c93273fc-0d70-480f-b5cf-073c04c4b6df): created successfully Jul 13 20:40:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3c1832-22d3-4738-bbb4-d9c08fa684ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:40:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Flow 'volume_create_manager' (421fbda9-cbb6-4105-a492-9ca9c7964ec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:40:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-aa5db485-f0c5-49f5-8a98-aecdaed118c6 tempest-CreateVolumesFromImageTest-891995824 None] Created volume successfully. Jul 13 20:40:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "cinder-c93273fc-0d70-480f-b5cf-073c04c4b6df-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-c93273fc-0d70-480f-b5cf-073c04c4b6df-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "cinder-quobyte-c93273fc-0d70-480f-b5cf-073c04c4b6df" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-quobyte-c93273fc-0d70-480f-b5cf-073c04c4b6df" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:56 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b425b8c-3c29-496b-8354-ffe4d6479d23]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:40:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c93273fc-0d70-480f-b5cf-073c04c4b6df {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:56 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c93273fc-0d70-480f-b5cf-073c04c4b6df Jul 13 20:40:56 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:56 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c93273fc-0d70-480f-b5cf-073c04c4b6df" returned: 0 in 0.364s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c93273fc-0d70-480f-b5cf-073c04c4b6df {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:56 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c93273fc-0d70-480f-b5cf-073c04c4b6df Jul 13 20:40:56 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:56 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c93273fc-0d70-480f-b5cf-073c04c4b6df" returned: 0 in 0.245s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-quobyte-c93273fc-0d70-480f-b5cf-073c04c4b6df" released by "delete_volume" :: held 0.649s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:57 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] Created reservations ['5b36eb65-331c-4b0d-b17d-4deeab9af081', '1fa678a6-78d9-48ec-a4fe-364c0240025e', '64d7abd0-801c-4c2b-b629-dc6480fe6332', '7fbc61df-0252-455d-9e57-6e6c571da9b5'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:40:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:40:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:40:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:57 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:40:57 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:57 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.241s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:57 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:40:57 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] Deleted volume successfully. Jul 13 20:40:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-18ca3734-591f-4303-b46c-264ca519f3df tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-c93273fc-0d70-480f-b5cf-073c04c4b6df-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "cinder-0eb20aeb-e851-453a-8cf2-d4f54be48c7e-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-0eb20aeb-e851-453a-8cf2-d4f54be48c7e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "cinder-quobyte-0eb20aeb-e851-453a-8cf2-d4f54be48c7e" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-quobyte-0eb20aeb-e851-453a-8cf2-d4f54be48c7e" acquired by "delete_volume" :: waited 0.013s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:57 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea774c9-2d22-4572-ae07-4c71a0d36a87]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:40:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0eb20aeb-e851-453a-8cf2-d4f54be48c7e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:57 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0eb20aeb-e851-453a-8cf2-d4f54be48c7e Jul 13 20:40:57 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:57 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0eb20aeb-e851-453a-8cf2-d4f54be48c7e" returned: 0 in 0.342s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0eb20aeb-e851-453a-8cf2-d4f54be48c7e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:57 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0eb20aeb-e851-453a-8cf2-d4f54be48c7e Jul 13 20:40:57 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:58 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0eb20aeb-e851-453a-8cf2-d4f54be48c7e" returned: 0 in 0.248s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-quobyte-0eb20aeb-e851-453a-8cf2-d4f54be48c7e" released by "delete_volume" :: held 0.629s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:58 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] Created reservations ['ebcc061d-bea5-4d6d-a53c-0ac9588e8abb', 'ff14c87c-c2a9-4e74-88df-5ce81b5b93af', '537c97b6-8d4e-42ee-ac48-9ced83619041', 'f43d324f-1167-4113-b155-5064b50fc096'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:40:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:40:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:40:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:58 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:40:58 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:58 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.256s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:58 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:40:58 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] Deleted volume successfully. Jul 13 20:40:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f1bb97b5-6d38-4b00-8852-da878e1b80ef tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-0eb20aeb-e851-453a-8cf2-d4f54be48c7e-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "cinder-5291c3a6-1b27-4ba3-9ef5-a69899c1742d-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-5291c3a6-1b27-4ba3-9ef5-a69899c1742d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "cinder-quobyte-5291c3a6-1b27-4ba3-9ef5-a69899c1742d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-quobyte-5291c3a6-1b27-4ba3-9ef5-a69899c1742d" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:58 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[01152faf-266c-4e0c-8af5-ef296ae0f33e]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:40:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5291c3a6-1b27-4ba3-9ef5-a69899c1742d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:58 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5291c3a6-1b27-4ba3-9ef5-a69899c1742d Jul 13 20:40:58 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:59 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5291c3a6-1b27-4ba3-9ef5-a69899c1742d" returned: 0 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5291c3a6-1b27-4ba3-9ef5-a69899c1742d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:59 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5291c3a6-1b27-4ba3-9ef5-a69899c1742d Jul 13 20:40:59 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:59 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5291c3a6-1b27-4ba3-9ef5-a69899c1742d" returned: 0 in 0.239s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-quobyte-5291c3a6-1b27-4ba3-9ef5-a69899c1742d" released by "delete_volume" :: held 0.681s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] Created reservations ['4c2b9f84-394f-436d-99e5-8cd24f36f110', '96e383b4-ffbe-4e0d-83b7-2929af88a7fd', '26d12466-53a8-4e8a-aff3-18fc373e966b', 'd1377951-78ed-4032-ba96-04e400ff4dbd'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:40:59 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:40:59 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:40:59 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.296s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:40:59 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] Deleted volume successfully. Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "cinder-501ddbfd-c027-487e-99a6-434919f31146-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-501ddbfd-c027-487e-99a6-434919f31146-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e11cf6fb-d41e-4a30-aa08-4437f7175115 tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-5291c3a6-1b27-4ba3-9ef5-a69899c1742d-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "cinder-quobyte-501ddbfd-c027-487e-99a6-434919f31146" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-quobyte-501ddbfd-c027-487e-99a6-434919f31146" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[737c2af0-1b78-4cda-9e79-6f1217767ac0]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:40:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501ddbfd-c027-487e-99a6-434919f31146 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:00 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501ddbfd-c027-487e-99a6-434919f31146 Jul 13 20:41:00 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:00 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501ddbfd-c027-487e-99a6-434919f31146" returned: 0 in 0.401s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501ddbfd-c027-487e-99a6-434919f31146 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:00 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501ddbfd-c027-487e-99a6-434919f31146 Jul 13 20:41:00 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:00 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501ddbfd-c027-487e-99a6-434919f31146" returned: 0 in 0.265s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-quobyte-501ddbfd-c027-487e-99a6-434919f31146" released by "delete_volume" :: held 0.720s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:41:00 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] Created reservations ['68459918-373c-466b-9109-4aeca33f6f17', '1faa0230-612e-4a2a-b382-b80b1b31a937', 'c5243276-4922-4a32-be5d-bd0555ec136e', '26681575-eeff-4bb8-8963-0c72b7137e8c'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:41:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:41:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:41:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:00 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:41:00 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "cinder-8270c136-178f-4fe9-84d0-02a48cc12dce-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:41:01 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.285s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-8270c136-178f-4fe9-84d0-02a48cc12dce-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:41:01 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] Deleted volume successfully. Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-63277529-7b27-461e-981f-b1f2693201bc tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-501ddbfd-c027-487e-99a6-434919f31146-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "cinder-quobyte-8270c136-178f-4fe9-84d0-02a48cc12dce" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-quobyte-8270c136-178f-4fe9-84d0-02a48cc12dce" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a2162d-9f83-445a-a1b3-9064b9ae40b2]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8270c136-178f-4fe9-84d0-02a48cc12dce {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:01 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8270c136-178f-4fe9-84d0-02a48cc12dce Jul 13 20:41:01 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:01 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8270c136-178f-4fe9-84d0-02a48cc12dce" returned: 0 in 0.369s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8270c136-178f-4fe9-84d0-02a48cc12dce {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:01 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8270c136-178f-4fe9-84d0-02a48cc12dce Jul 13 20:41:01 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:01 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8270c136-178f-4fe9-84d0-02a48cc12dce" returned: 0 in 0.269s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-quobyte-8270c136-178f-4fe9-84d0-02a48cc12dce" released by "delete_volume" :: held 0.684s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] Created reservations ['634e3f8e-d15f-4768-91dd-23dabef14069', '58a5888f-ede4-4d9d-96a2-8f0d2b402509', 'b9ea356f-2a21-45a9-9035-44cd17959af7', '613c25d0-31b0-4c40-a564-38f4328bbe71'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:02 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:41:02 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:02 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.265s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:02 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:41:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] Deleted volume successfully. Jul 13 20:41:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4c6c3441-233e-4270-943f-173df15e5d24 tempest-CreateVolumesFromImageTest-891995824 None] Lock "cinder-8270c136-178f-4fe9-84d0-02a48cc12dce-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Flow 'volume_create_manager' (ba977824-0ad6-438e-b29c-3b7806ca5404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95edd236-1de4-4cb0-b917-299e4575647d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95edd236-1de4-4cb0-b917-299e4575647d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-357498546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f199a111d1a243058c4b58a61cbc7c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:41:04Z,use_quota=True,user_id='c21c6e2a7e774b15af458a4f53826456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551a53b5-2472-4aeb-9b96-f80c9222f441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551a53b5-2472-4aeb-9b96-f80c9222f441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648af996-ae26-4883-9566-f966ed4fae46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648af996-ae26-4883-9566-f966ed4fae46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc', 'volume_name': 'volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf80b8d-610e-40ac-9c8e-157ca86b0051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf80b8d-610e-40ac-9c8e-157ca86b0051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44caaded-4c92-4147-b7cb-b2853e350641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Volume 90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc', 'volume_size': 1} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-357498546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f199a111d1a243058c4b58a61cbc7c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:41:04Z,use_quota=True,user_id='c21c6e2a7e774b15af458a4f53826456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Creating volume 90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:41:04 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:04 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc 1073741824 Jul 13 20:41:04 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:04 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc 1073741824" returned: 0 in 0.523s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:04 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc Jul 13 20:41:04 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:05 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc" returned: 0 in 0.292s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44caaded-4c92-4147-b7cb-b2853e350641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e42376-1f5d-4a54-a4c5-84c133f22a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Volume volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc (90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc): created successfully Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e42376-1f5d-4a54-a4c5-84c133f22a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Flow 'volume_create_manager' (ba977824-0ad6-438e-b29c-3b7806ca5404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:41:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d07d1667-f869-4992-be4b-e83e93ebd225 tempest-AttachVolumeNegativeTest-1019566619 None] Created volume successfully. Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Flow 'volume_create_manager' (cd58d4e6-f53f-493a-9424-40c1fdf27d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8a00d1-5255-4c7b-8dde-f17f0bb4e957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8a00d1-5255-4c7b-8dde-f17f0bb4e957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f1c041f-9720-4c6b-b320-1f1800a31cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9fec024d3b04b31acd64ea0a87634b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:41:05Z,use_quota=True,user_id='c15204218a324e73801b7f709c59f60b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04678521-eeb7-413d-93f9-2ed0517ee10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04678521-eeb7-413d-93f9-2ed0517ee10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c9e9ad-fb33-4814-b971-b40f1dd806da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c9e9ad-fb33-4814-b971-b40f1dd806da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f1c041f-9720-4c6b-b320-1f1800a31cc6', 'volume_name': 'volume-8f1c041f-9720-4c6b-b320-1f1800a31cc6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e8375e-ae92-42d9-bec9-42d8faad93e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e8375e-ae92-42d9-bec9-42d8faad93e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0247074-1ef4-4197-96df-6a1d53dc2a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Volume 8f1c041f-9720-4c6b-b320-1f1800a31cc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f1c041f-9720-4c6b-b320-1f1800a31cc6', 'volume_size': 1} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f1c041f-9720-4c6b-b320-1f1800a31cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9fec024d3b04b31acd64ea0a87634b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:41:05Z,use_quota=True,user_id='c15204218a324e73801b7f709c59f60b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Creating volume 8f1c041f-9720-4c6b-b320-1f1800a31cc6 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:41:05 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8f1c041f-9720-4c6b-b320-1f1800a31cc6 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:05 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8f1c041f-9720-4c6b-b320-1f1800a31cc6 1073741824 Jul 13 20:41:05 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:05 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8f1c041f-9720-4c6b-b320-1f1800a31cc6 1073741824" returned: 0 in 0.493s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8f1c041f-9720-4c6b-b320-1f1800a31cc6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:05 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8f1c041f-9720-4c6b-b320-1f1800a31cc6 Jul 13 20:41:05 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:06 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8f1c041f-9720-4c6b-b320-1f1800a31cc6" returned: 0 in 0.302s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:41:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0247074-1ef4-4197-96df-6a1d53dc2a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f1c041f-9720-4c6b-b320-1f1800a31cc6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe63e6b-18c6-4d24-92a4-c7c616a2a075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:06 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Volume volume-8f1c041f-9720-4c6b-b320-1f1800a31cc6 (8f1c041f-9720-4c6b-b320-1f1800a31cc6): created successfully Jul 13 20:41:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe63e6b-18c6-4d24-92a4-c7c616a2a075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Flow 'volume_create_manager' (cd58d4e6-f53f-493a-9424-40c1fdf27d76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:41:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e168dffe-0dcb-4c4b-af2e-46596ece82c1 tempest-CinderUnicodeTest-367971050 None] Created volume successfully. Jul 13 20:41:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-9405d371-4257-4754-94b3-84b08983cc46 req-e14a2b40-d84d-4b3d-92fe-a4c352768d10 tempest-TestShelveInstance-2082562858 None] Terminate volume connection completed successfully. Jul 13 20:41:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-9405d371-4257-4754-94b3-84b08983cc46 req-e14a2b40-d84d-4b3d-92fe-a4c352768d10 tempest-TestShelveInstance-2082562858 None] Deleting attachment 006561f4-e7d8-458b-be9c-59e00e59f88f. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:41:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a7f1c9d9-42a1-4ba7-ae0e-1577b13a510c req-bc72e63e-fdfc-4b39-8e1a-c89a84b69089 tempest-AttachVolumeNegativeTest-1019566619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a7f1c9d9-42a1-4ba7-ae0e-1577b13a510c req-bc72e63e-fdfc-4b39-8e1a-c89a84b69089 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:07 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[515e124b-c0f4-4a0a-a863-f34e73227d67]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:41:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-a7f1c9d9-42a1-4ba7-ae0e-1577b13a510c req-bc72e63e-fdfc-4b39-8e1a-c89a84b69089 tempest-AttachVolumeNegativeTest-1019566619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:07 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc Jul 13 20:41:07 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:07 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-a7f1c9d9-42a1-4ba7-ae0e-1577b13a510c req-bc72e63e-fdfc-4b39-8e1a-c89a84b69089 tempest-AttachVolumeNegativeTest-1019566619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc" returned: 0 in 0.397s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a7f1c9d9-42a1-4ba7-ae0e-1577b13a510c req-bc72e63e-fdfc-4b39-8e1a-c89a84b69089 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.416s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a7f1c9d9-42a1-4ba7-ae0e-1577b13a510c req-bc72e63e-fdfc-4b39-8e1a-c89a84b69089 tempest-AttachVolumeNegativeTest-1019566619 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22a5e85b-99a7-4a5a-a69a-d3485c6c2342', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:41:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-a7f1c9d9-42a1-4ba7-ae0e-1577b13a510c req-bc72e63e-fdfc-4b39-8e1a-c89a84b69089 tempest-AttachVolumeNegativeTest-1019566619 None] attachment_update completed successfully. Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Flow 'volume_create_manager' (26526f2b-e8bb-4a27-8999-b38ed0723f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc005fb1-9594-412a-946c-809c69580bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc005fb1-9594-412a-946c-809c69580bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:41:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-583941949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9fec024d3b04b31acd64ea0a87634b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:41:08Z,use_quota=True,user_id='c15204218a324e73801b7f709c59f60b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a823e1d-ac5c-4a58-9519-dfdace0d44cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a823e1d-ac5c-4a58-9519-dfdace0d44cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7212b83-7426-451c-b407-e48ddd9abe53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7212b83-7426-451c-b407-e48ddd9abe53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8', 'volume_name': 'volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbda40b7-37ff-473e-a862-66409ee2f469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbda40b7-37ff-473e-a862-66409ee2f469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bdb0dc5-f56f-460b-8047-21474e85d201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:08 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Volume 3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8', 'volume_size': 1} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:41:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-583941949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9fec024d3b04b31acd64ea0a87634b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:41:08Z,use_quota=True,user_id='c15204218a324e73801b7f709c59f60b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Creating volume 3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:41:08 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:08 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 1073741824 Jul 13 20:41:08 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:08 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 1073741824" returned: 0 in 0.492s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:08 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 Jul 13 20:41:08 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:08 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8" returned: 0 in 0.278s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bdb0dc5-f56f-460b-8047-21474e85d201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70725a8-0a2d-4b0c-9829-af093855de9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:08 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Volume volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 (3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8): created successfully Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70725a8-0a2d-4b0c-9829-af093855de9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Flow 'volume_create_manager' (26526f2b-e8bb-4a27-8999-b38ed0723f5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:41:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ebe51007-9916-4393-a1c8-17d41a1705be tempest-CinderUnicodeTest-367971050 None] Created volume successfully. Jul 13 20:41:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-df5a2f31-f88b-4b3b-a2bc-cd3a1c20e790 req-609c33a6-caea-4424-b6e5-97ddaa7bd6ce tempest-TestShelveInstance-2082562858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-df5a2f31-f88b-4b3b-a2bc-cd3a1c20e790 req-609c33a6-caea-4424-b6e5-97ddaa7bd6ce tempest-TestShelveInstance-2082562858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:10 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0da8fb1-6039-4218-95bc-76fb8bb79c33]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:41:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-df5a2f31-f88b-4b3b-a2bc-cd3a1c20e790 req-609c33a6-caea-4424-b6e5-97ddaa7bd6ce tempest-TestShelveInstance-2082562858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:10 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 Jul 13 20:41:10 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26c8b8a2-6e3c-48c2-84b2-0325d321cf97 tempest-CinderUnicodeTest-367971050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:10 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-df5a2f31-f88b-4b3b-a2bc-cd3a1c20e790 req-609c33a6-caea-4424-b6e5-97ddaa7bd6ce tempest-TestShelveInstance-2082562858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4" returned: 0 in 0.386s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-df5a2f31-f88b-4b3b-a2bc-cd3a1c20e790 req-609c33a6-caea-4424-b6e5-97ddaa7bd6ce tempest-TestShelveInstance-2082562858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:10 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 Jul 13 20:41:10 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:10 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-df5a2f31-f88b-4b3b-a2bc-cd3a1c20e790 req-609c33a6-caea-4424-b6e5-97ddaa7bd6ce tempest-TestShelveInstance-2082562858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4" returned: 1 in 0.362s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-df5a2f31-f88b-4b3b-a2bc-cd3a1c20e790 req-609c33a6-caea-4424-b6e5-97ddaa7bd6ce tempest-TestShelveInstance-2082562858 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:41:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-df5a2f31-f88b-4b3b-a2bc-cd3a1c20e790 req-609c33a6-caea-4424-b6e5-97ddaa7bd6ce tempest-TestShelveInstance-2082562858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.816s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26c8b8a2-6e3c-48c2-84b2-0325d321cf97 tempest-CinderUnicodeTest-367971050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.511s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-26c8b8a2-6e3c-48c2-84b2-0325d321cf97 tempest-CinderUnicodeTest-367971050 None] Creating offline snapshot 0253d427-7c3a-4369-9775-b6ef023b96d6 of volume 3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:41:11 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c27c24-5ce5-4cf4-8730-018a947c120f]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:41:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26c8b8a2-6e3c-48c2-84b2-0325d321cf97 tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-df5a2f31-f88b-4b3b-a2bc-cd3a1c20e790 req-609c33a6-caea-4424-b6e5-97ddaa7bd6ce tempest-TestShelveInstance-2082562858 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-eba613ba-e473-41e4-b7db-05269a3096c4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65dbeddc-0c2a-499a-a382-e97ea2bc8a18', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:41:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-df5a2f31-f88b-4b3b-a2bc-cd3a1c20e790 req-609c33a6-caea-4424-b6e5-97ddaa7bd6ce tempest-TestShelveInstance-2082562858 None] attachment_update completed successfully. Jul 13 20:41:11 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 Jul 13 20:41:11 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:11 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26c8b8a2-6e3c-48c2-84b2-0325d321cf97 tempest-CinderUnicodeTest-367971050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8" returned: 0 in 0.530s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26c8b8a2-6e3c-48c2-84b2-0325d321cf97 tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:11 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6 1G Jul 13 20:41:11 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:12 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26c8b8a2-6e3c-48c2-84b2-0325d321cf97 tempest-CinderUnicodeTest-367971050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6 1G" returned: 0 in 0.519s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26c8b8a2-6e3c-48c2-84b2-0325d321cf97 tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:12 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6 Jul 13 20:41:12 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:12 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26c8b8a2-6e3c-48c2-84b2-0325d321cf97 tempest-CinderUnicodeTest-367971050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6" returned: 0 in 0.342s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:12 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-26c8b8a2-6e3c-48c2-84b2-0325d321cf97 tempest-CinderUnicodeTest-367971050 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6 is being set with open permissions: ugo+rw Jul 13 20:41:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26c8b8a2-6e3c-48c2-84b2-0325d321cf97 tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:12 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6 Jul 13 20:41:12 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:12 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26c8b8a2-6e3c-48c2-84b2-0325d321cf97 tempest-CinderUnicodeTest-367971050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6" returned: 0 in 0.327s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26c8b8a2-6e3c-48c2-84b2-0325d321cf97 tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:12 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.info Jul 13 20:41:12 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:13 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26c8b8a2-6e3c-48c2-84b2-0325d321cf97 tempest-CinderUnicodeTest-367971050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.info" returned: 0 in 0.353s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:13 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-26c8b8a2-6e3c-48c2-84b2-0325d321cf97 tempest-CinderUnicodeTest-367971050 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.info is being set with open permissions: ugo+rw Jul 13 20:41:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26c8b8a2-6e3c-48c2-84b2-0325d321cf97 tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:13 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.info Jul 13 20:41:13 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:13 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26c8b8a2-6e3c-48c2-84b2-0325d321cf97 tempest-CinderUnicodeTest-367971050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.info" returned: 0 in 0.276s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26c8b8a2-6e3c-48c2-84b2-0325d321cf97 tempest-CinderUnicodeTest-367971050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.455s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:13 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-26c8b8a2-6e3c-48c2-84b2-0325d321cf97 tempest-CinderUnicodeTest-367971050 None] Create snapshot completed successfully Jul 13 20:41:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] Acquiring lock "cinder-0253d427-7c3a-4369-9775-b6ef023b96d6-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:41:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] Lock "cinder-0253d427-7c3a-4369-9775-b6ef023b96d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:41:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] Acquiring lock "cinder-quobyte-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:41:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] Lock "cinder-quobyte-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:41:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] Acquiring lock "cinder-quobyte-0253d427-7c3a-4369-9775-b6ef023b96d6" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:41:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] Lock "cinder-quobyte-0253d427-7c3a-4369-9775-b6ef023b96d6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:41:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] Deleting offline snapshot 0253d427-7c3a-4369-9775-b6ef023b96d6 of volume 3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:41:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] snapshot_file for this snap is: volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:41:13 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5497be-603c-4412-9302-b49bd47d2eec]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:41:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:14 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6 Jul 13 20:41:14 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:14 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6" returned: 0 in 0.914s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:41:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad268cc6-05fa-492b-87b9-dec34bdcdb79]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:41:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:15 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 Jul 13 20:41:15 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:15 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8" returned: 0 in 0.761s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:15 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6 Jul 13 20:41:15 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:16 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6" returned: 0 in 0.420s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:16 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6 Jul 13 20:41:16 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:16 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8.0253d427-7c3a-4369-9775-b6ef023b96d6" returned: 0 in 0.473s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] Lock "cinder-quobyte-0253d427-7c3a-4369-9775-b6ef023b96d6" released by "_delete_snapshot" :: held 2.773s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:41:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] Lock "cinder-quobyte-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8" released by "delete_snapshot" :: held 2.804s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:41:16 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] Created reservations ['72f40caa-4682-4c1e-a801-0cd754561e80', '9bbf219b-d493-447d-9de7-e558111263f9', 'c83e742a-4bf1-485e-b5f8-c1cd764f803e', '27b3bccc-aca2-4317-9cb2-c46d60daa298'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:41:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] Delete snapshot completed successfully. Jul 13 20:41:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cf313f7-986d-4814-b14f-2e602d2aa213 tempest-CinderUnicodeTest-367971050 None] Lock "cinder-0253d427-7c3a-4369-9775-b6ef023b96d6-delete_snapshot" released by "delete_snapshot" :: held 3.031s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:41:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] Acquiring lock "cinder-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:41:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] Lock "cinder-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:41:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] Acquiring lock "cinder-quobyte-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:41:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] Lock "cinder-quobyte-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8" acquired by "delete_volume" :: waited 0.039s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:41:17 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12f050c-cf51-4f8d-923d-9faaae06c17a]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:41:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:17 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 Jul 13 20:41:17 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:17 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8" returned: 0 in 0.491s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:17 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8 Jul 13 20:41:17 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:18 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8" returned: 0 in 0.439s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] Lock "cinder-quobyte-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8" released by "delete_volume" :: held 1.091s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:41:18 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] Created reservations ['77060988-a383-4dbd-bfad-e8b26c768f7e', '52a6afc1-d6d4-4f20-80e2-a21b3363a1f8', '67b2f89b-deb0-418b-b00a-d60d0bc40e47', '82364ae2-631d-486f-9164-02b2342f3224'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:41:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:41:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:41:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:18 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:41:18 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:41:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:41:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:41:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:18 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:41:18 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:19 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.571s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:41:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] Deleted volume successfully. Jul 13 20:41:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6b9ffac7-c2d0-458c-95a5-2cfc0fe09a41 tempest-CinderUnicodeTest-367971050 None] Lock "cinder-3ec8f1f6-c8a4-4d09-9e6e-b36df80535f8-delete_volume" released by "delete_volume" :: held 2.210s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:41:19 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.515s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:41:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:41:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:41:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:41:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] Acquiring lock "cinder-8f1c041f-9720-4c6b-b320-1f1800a31cc6-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:41:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] Lock "cinder-8f1c041f-9720-4c6b-b320-1f1800a31cc6-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:41:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] Acquiring lock "cinder-quobyte-8f1c041f-9720-4c6b-b320-1f1800a31cc6" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:41:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] Lock "cinder-quobyte-8f1c041f-9720-4c6b-b320-1f1800a31cc6" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:41:19 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d294b5d0-24d6-4cd4-98d7-74adc039f018]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:41:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8f1c041f-9720-4c6b-b320-1f1800a31cc6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:19 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8f1c041f-9720-4c6b-b320-1f1800a31cc6 Jul 13 20:41:19 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:20 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8f1c041f-9720-4c6b-b320-1f1800a31cc6" returned: 0 in 0.412s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8f1c041f-9720-4c6b-b320-1f1800a31cc6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:20 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8f1c041f-9720-4c6b-b320-1f1800a31cc6 Jul 13 20:41:20 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:20 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8f1c041f-9720-4c6b-b320-1f1800a31cc6" returned: 0 in 0.359s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] Lock "cinder-quobyte-8f1c041f-9720-4c6b-b320-1f1800a31cc6" released by "delete_volume" :: held 0.837s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:41:20 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] Created reservations ['e0f4af94-8ad4-4fd3-a8e2-66513cfbe4fd', 'dd55b9fa-12c1-4124-b1ce-65c8ceb54313', '0d0813c1-4846-4d4e-8220-2b32d516302f', 'f71d366a-6ff8-4a5d-b6aa-891ec9446389'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:41:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:41:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:41:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:20 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:41:20 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:21 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.348s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:21 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:41:21 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] Deleted volume successfully. Jul 13 20:41:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92fdddce-7ded-4244-9133-d4ba1a656de2 tempest-CinderUnicodeTest-367971050 None] Lock "cinder-8f1c041f-9720-4c6b-b320-1f1800a31cc6-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:41:30 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=78,cinder:SELECT=73,cinder:DELETE=12,cinder:INSERT=22 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:41:31 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=71,cinder:UPDATE=102,cinder:INSERT=19,cinder:DELETE=4 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Flow 'volume_create_manager' (17645c22-65f5-4b78-b715-d2847a8d8619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e373c50a-92d2-465f-b4a3-89efecbc27f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e373c50a-92d2-465f-b4a3-89efecbc27f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-412379192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d645842f-ebc8-4cd6-96fe-84759e184fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a1000d74a24bffbed582d44333bbed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:41:42Z,use_quota=True,user_id='9769bf713ee14f8d87061ed874b4fb9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829816ce-cdae-4d6d-8d45-d9ee525f0c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829816ce-cdae-4d6d-8d45-d9ee525f0c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b89e3c4-5b99-497d-a086-cb69f17682dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b89e3c4-5b99-497d-a086-cb69f17682dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd645842f-ebc8-4cd6-96fe-84759e184fa0', 'volume_name': 'volume-d645842f-ebc8-4cd6-96fe-84759e184fa0', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9bbb16-deb6-46b0-8977-76ca57780a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9bbb16-deb6-46b0-8977-76ca57780a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d280c4-e314-48b7-9e64-8b81921e7038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:42 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Volume d645842f-ebc8-4cd6-96fe-84759e184fa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d645842f-ebc8-4cd6-96fe-84759e184fa0', 'volume_size': 1} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-412379192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d645842f-ebc8-4cd6-96fe-84759e184fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a1000d74a24bffbed582d44333bbed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:41:42Z,use_quota=True,user_id='9769bf713ee14f8d87061ed874b4fb9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Creating volume d645842f-ebc8-4cd6-96fe-84759e184fa0 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:41:42 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:42 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 1073741824 Jul 13 20:41:42 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:42 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 1073741824" returned: 0 in 0.509s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:42 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 Jul 13 20:41:42 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:43 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0" returned: 0 in 0.261s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:41:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d280c4-e314-48b7-9e64-8b81921e7038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d645842f-ebc8-4cd6-96fe-84759e184fa0', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de8b616-a1f5-4222-abf7-3f72171b3193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:43 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Volume volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 (d645842f-ebc8-4cd6-96fe-84759e184fa0): created successfully Jul 13 20:41:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de8b616-a1f5-4222-abf7-3f72171b3193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Flow 'volume_create_manager' (17645c22-65f5-4b78-b715-d2847a8d8619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:41:43 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-63b6834a-70c7-487a-817a-7587b8294a07 tempest-SnapshotDependencyTests-1363813625 None] Created volume successfully. Jul 13 20:41:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d45f440-f044-43f2-aa4f-efa6efca3dd4 tempest-SnapshotDependencyTests-1363813625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d45f440-f044-43f2-aa4f-efa6efca3dd4 tempest-SnapshotDependencyTests-1363813625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9d45f440-f044-43f2-aa4f-efa6efca3dd4 tempest-SnapshotDependencyTests-1363813625 None] Creating offline snapshot f6fc6afa-45cb-4694-bfed-d2a994ab868c of volume d645842f-ebc8-4cd6-96fe-84759e184fa0 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:41:44 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d08f0aa-8e64-464f-8e2f-577ad0786d74]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:41:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d45f440-f044-43f2-aa4f-efa6efca3dd4 tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:44 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 Jul 13 20:41:44 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:44 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d45f440-f044-43f2-aa4f-efa6efca3dd4 tempest-SnapshotDependencyTests-1363813625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0" returned: 0 in 0.358s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d45f440-f044-43f2-aa4f-efa6efca3dd4 tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:44 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c 1G Jul 13 20:41:44 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:45 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d45f440-f044-43f2-aa4f-efa6efca3dd4 tempest-SnapshotDependencyTests-1363813625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c 1G" returned: 0 in 0.383s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d45f440-f044-43f2-aa4f-efa6efca3dd4 tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:45 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c Jul 13 20:41:45 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:45 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d45f440-f044-43f2-aa4f-efa6efca3dd4 tempest-SnapshotDependencyTests-1363813625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c" returned: 0 in 0.313s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:45 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-9d45f440-f044-43f2-aa4f-efa6efca3dd4 tempest-SnapshotDependencyTests-1363813625 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c is being set with open permissions: ugo+rw Jul 13 20:41:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d45f440-f044-43f2-aa4f-efa6efca3dd4 tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:45 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c Jul 13 20:41:45 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:45 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d45f440-f044-43f2-aa4f-efa6efca3dd4 tempest-SnapshotDependencyTests-1363813625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c" returned: 0 in 0.285s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d45f440-f044-43f2-aa4f-efa6efca3dd4 tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:45 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.info Jul 13 20:41:45 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:46 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d45f440-f044-43f2-aa4f-efa6efca3dd4 tempest-SnapshotDependencyTests-1363813625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.info" returned: 0 in 0.322s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:46 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-9d45f440-f044-43f2-aa4f-efa6efca3dd4 tempest-SnapshotDependencyTests-1363813625 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.info is being set with open permissions: ugo+rw Jul 13 20:41:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d45f440-f044-43f2-aa4f-efa6efca3dd4 tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:46 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.info Jul 13 20:41:46 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:46 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d45f440-f044-43f2-aa4f-efa6efca3dd4 tempest-SnapshotDependencyTests-1363813625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.info" returned: 0 in 0.310s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d45f440-f044-43f2-aa4f-efa6efca3dd4 tempest-SnapshotDependencyTests-1363813625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.092s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:46 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9d45f440-f044-43f2-aa4f-efa6efca3dd4 tempest-SnapshotDependencyTests-1363813625 None] Create snapshot completed successfully Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Flow 'volume_create_manager' (90cf38fe-9d42-4f45-a777-79dd659b716e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80155978-dea9-4fe7-9f0c-727c05dfac33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80155978-dea9-4fe7-9f0c-727c05dfac33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd80906-cdb9-4751-99c4-24c3fbdae93e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a1000d74a24bffbed582d44333bbed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f6fc6afa-45cb-4694-bfed-d2a994ab868c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:41:48Z,use_quota=True,user_id='9769bf713ee14f8d87061ed874b4fb9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6492e42c-08e4-48f6-a532-5c0e2d06976a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6492e42c-08e4-48f6-a532-5c0e2d06976a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8c14c2-caee-430c-8023-cd424920df27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8c14c2-caee-430c-8023-cd424920df27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6fd80906-cdb9-4751-99c4-24c3fbdae93e', 'volume_name': 'volume-6fd80906-cdb9-4751-99c4-24c3fbdae93e', 'volume_size': 1, 'snapshot_id': 'f6fc6afa-45cb-4694-bfed-d2a994ab868c'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (841f8b0a-cf71-4b24-a3b2-663e1a07dedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (841f8b0a-cf71-4b24-a3b2-663e1a07dedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89b4cab-25c0-4b51-bd6f-e2eb24202e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:48 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Volume 6fd80906-cdb9-4751-99c4-24c3fbdae93e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6fd80906-cdb9-4751-99c4-24c3fbdae93e', 'volume_size': 1, 'snapshot_id': 'f6fc6afa-45cb-4694-bfed-d2a994ab868c'} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Acquiring lock "cinder-quobyte-f6fc6afa-45cb-4694-bfed-d2a994ab868c-6fd80906-cdb9-4751-99c4-24c3fbdae93e" by "_create_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Lock "cinder-quobyte-f6fc6afa-45cb-4694-bfed-d2a994ab868c-6fd80906-cdb9-4751-99c4-24c3fbdae93e" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Creating volume 6fd80906-cdb9-4751-99c4-24c3fbdae93e from snapshot f6fc6afa-45cb-4694-bfed-d2a994ab868c {{(pid=87269) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Acquiring lock "cinder-quobyte-6fd80906-cdb9-4751-99c4-24c3fbdae93e" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Lock "cinder-quobyte-6fd80906-cdb9-4751-99c4-24c3fbdae93e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] snapshot: f6fc6afa-45cb-4694-bfed-d2a994ab868c, volume: 6fd80906-cdb9-4751-99c4-24c3fbdae93e, {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53c287a-a1ed-460d-aea9-74fe2a1e376c]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:48 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c Jul 13 20:41:48 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:48 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c" returned: 0 in 0.382s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d645842f-ebc8-4cd6-96fe-84759e184fa0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaa0b05-c47f-46a3-865b-80070f668ce9]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:41:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:49 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 Jul 13 20:41:49 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:49 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0" returned: 0 in 0.403s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:49 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Path /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-6fd80906-cdb9-4751-99c4-24c3fbdae93e not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 20:41:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-6fd80906-cdb9-4751-99c4-24c3fbdae93e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:49 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-6fd80906-cdb9-4751-99c4-24c3fbdae93e Jul 13 20:41:49 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:50 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-7ee1d7b2-072b-4bcf-858e-cefb130899c8 req-ab05a531-ed8e-48fb-8f87-9c4d9136c469 tempest-AttachVolumeNegativeTest-1019566619 None] Terminate volume connection completed successfully. Jul 13 20:41:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-7ee1d7b2-072b-4bcf-858e-cefb130899c8 req-ab05a531-ed8e-48fb-8f87-9c4d9136c469 tempest-AttachVolumeNegativeTest-1019566619 None] Deleting attachment 22a5e85b-99a7-4a5a-a69a-d3485c6c2342. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:41:54 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-6fd80906-cdb9-4751-99c4-24c3fbdae93e" returned: 0 in 5.389s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:54 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c57958-e366-4d1e-b037-8f1bae009ad6]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:41:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:54 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 Jul 13 20:41:54 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:55 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0" returned: 0 in 0.626s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:55 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-6fd80906-cdb9-4751-99c4-24c3fbdae93e {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:41:55 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Converted 1024.00 MB image at 189.98 MB/s Jul 13 20:41:55 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-6fd80906-cdb9-4751-99c4-24c3fbdae93e is being set with open permissions: ugo+rw Jul 13 20:41:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-6fd80906-cdb9-4751-99c4-24c3fbdae93e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:55 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-6fd80906-cdb9-4751-99c4-24c3fbdae93e Jul 13 20:41:55 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:55 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-6fd80906-cdb9-4751-99c4-24c3fbdae93e" returned: 0 in 0.305s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Lock "cinder-quobyte-6fd80906-cdb9-4751-99c4-24c3fbdae93e" released by "_copy_volume_from_snapshot" :: held 7.221s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:41:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Lock "cinder-quobyte-f6fc6afa-45cb-4694-bfed-d2a994ab868c-6fd80906-cdb9-4751-99c4-24c3fbdae93e" released by "_create_volume_from_snapshot" :: held 7.252s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:41:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.270s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89b4cab-25c0-4b51-bd6f-e2eb24202e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fd80906-cdb9-4751-99c4-24c3fbdae93e', 'volume_size': 1, 'snapshot_id': 'f6fc6afa-45cb-4694-bfed-d2a994ab868c'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c566c902-5d8b-497b-a250-cbf6c0df6c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:41:55 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Volume volume-6fd80906-cdb9-4751-99c4-24c3fbdae93e (6fd80906-cdb9-4751-99c4-24c3fbdae93e): created successfully Jul 13 20:41:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c566c902-5d8b-497b-a250-cbf6c0df6c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:41:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Flow 'volume_create_manager' (90cf38fe-9d42-4f45-a777-79dd659b716e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:41:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-af88601a-fdae-45e4-9452-4c28fed27049 tempest-SnapshotDependencyTests-1363813625 None] Created volume successfully. Jul 13 20:41:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] Acquiring lock "cinder-f6fc6afa-45cb-4694-bfed-d2a994ab868c-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:41:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] Lock "cinder-f6fc6afa-45cb-4694-bfed-d2a994ab868c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:41:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] Acquiring lock "cinder-quobyte-d645842f-ebc8-4cd6-96fe-84759e184fa0" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:41:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] Lock "cinder-quobyte-d645842f-ebc8-4cd6-96fe-84759e184fa0" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:41:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] Acquiring lock "cinder-quobyte-f6fc6afa-45cb-4694-bfed-d2a994ab868c" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:41:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] Lock "cinder-quobyte-f6fc6afa-45cb-4694-bfed-d2a994ab868c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:41:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] Deleting offline snapshot f6fc6afa-45cb-4694-bfed-d2a994ab868c of volume d645842f-ebc8-4cd6-96fe-84759e184fa0 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:41:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] snapshot_file for this snap is: volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:41:56 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cd9b6f-54c2-4f0b-beec-5827892b5c69]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:41:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:56 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c Jul 13 20:41:56 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:56 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c" returned: 0 in 0.430s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d645842f-ebc8-4cd6-96fe-84759e184fa0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:41:57 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc40d8b-ae5f-4dd7-8374-85650ef96284]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:41:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:57 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 Jul 13 20:41:57 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:57 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0" returned: 0 in 0.452s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:57 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c Jul 13 20:41:57 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:57 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-ebdd2f5c-0d88-4475-8985-0098e963f27c tempest-TestShelveInstance-2082562858 None] Terminate volume connection completed successfully. Jul 13 20:41:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-ebdd2f5c-0d88-4475-8985-0098e963f27c tempest-TestShelveInstance-2082562858 None] Deleting attachment 65dbeddc-0c2a-499a-a382-e97ea2bc8a18. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:41:57 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c" returned: 0 in 0.496s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:58 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c Jul 13 20:41:58 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] Acquiring lock "cinder-eba613ba-e473-41e4-b7db-05269a3096c4-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:41:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] Lock "cinder-eba613ba-e473-41e4-b7db-05269a3096c4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:41:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] Acquiring lock "cinder-quobyte-eba613ba-e473-41e4-b7db-05269a3096c4" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:41:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] Lock "cinder-quobyte-eba613ba-e473-41e4-b7db-05269a3096c4" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:41:58 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d924e505-6a2d-48d9-a961-4d7425eaa7e8]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:41:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:58 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0.f6fc6afa-45cb-4694-bfed-d2a994ab868c" returned: 0 in 0.315s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] Lock "cinder-quobyte-f6fc6afa-45cb-4694-bfed-d2a994ab868c" released by "_delete_snapshot" :: held 1.826s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:41:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] Lock "cinder-quobyte-d645842f-ebc8-4cd6-96fe-84759e184fa0" released by "delete_snapshot" :: held 1.860s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:41:58 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 Jul 13 20:41:58 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:58 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] Created reservations ['f6c3bc64-9bbd-47e0-ad3d-c861bbad6909', '0c8cd7f6-de5e-4882-a70a-1e8f4bdbf134', '20f8624d-dbfc-42f9-a788-ce482b6a0283', 'ade4b14e-c841-4c30-bf1c-07f75de22a31'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:41:58 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] Delete snapshot completed successfully. Jul 13 20:41:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7404e507-efde-4164-acd5-d9742e97413a tempest-SnapshotDependencyTests-1363813625 None] Lock "cinder-f6fc6afa-45cb-4694-bfed-d2a994ab868c-delete_snapshot" released by "delete_snapshot" :: held 2.145s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:41:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] Acquiring lock "cinder-d645842f-ebc8-4cd6-96fe-84759e184fa0-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:41:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] Lock "cinder-d645842f-ebc8-4cd6-96fe-84759e184fa0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:41:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] Acquiring lock "cinder-quobyte-d645842f-ebc8-4cd6-96fe-84759e184fa0" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:41:58 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4" returned: 0 in 0.516s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] Lock "cinder-quobyte-d645842f-ebc8-4cd6-96fe-84759e184fa0" acquired by "delete_volume" :: waited 0.043s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:41:58 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[022120a8-06ab-4158-896d-1e47515d4ec1]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:41:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:58 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 Jul 13 20:41:58 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:58 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 Jul 13 20:41:58 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:59 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4" returned: 1 in 0.466s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:59 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4 Jul 13 20:41:59 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:59 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0" returned: 0 in 0.511s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:59 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0 Jul 13 20:41:59 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:59 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-eba613ba-e473-41e4-b7db-05269a3096c4" returned: 0 in 0.326s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] Lock "cinder-quobyte-eba613ba-e473-41e4-b7db-05269a3096c4" released by "delete_volume" :: held 1.402s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG cinder.quota [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] Created reservations ['3c1d0e82-8ac9-49de-8c6f-ac4fb02f2440', '680df8f7-5a81-4ac4-a5db-2554e1a3f77a', '057ce89e-e583-442b-b4b0-b887ecd9274b', '54d331d2-bbce-4bdb-af2e-e56e94c35405'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:41:59 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d645842f-ebc8-4cd6-96fe-84759e184fa0" returned: 0 in 0.330s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] Lock "cinder-quobyte-d645842f-ebc8-4cd6-96fe-84759e184fa0" released by "delete_volume" :: held 0.918s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] Created reservations ['c4aa1080-1ded-4296-b09e-07de0dc37d9c', '25a80ef0-c908-4712-b41a-a4280465e8df', '41d0b177-4688-4f7a-bd14-380c47c2d522', 'c5879683-9c55-406e-bdd8-9741586a4a9a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:41:59 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:41:59 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:41:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:41:59 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:41:59 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:42:00 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Jul 13 20:42:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.380s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:42:00 devstack cinder-volume[87269]: DEBUG cinder.manager [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:42:00 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] Deleted volume successfully. Jul 13 20:42:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-b6e47aa4-a860-4f19-9e88-d555c25b4736 req-8edbc6bf-7a4a-48f7-ba2c-7d5a5b3011d7 tempest-TestShelveInstance-2082562858 None] Lock "cinder-eba613ba-e473-41e4-b7db-05269a3096c4-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:42:00 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Jul 13 20:42:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.293s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:42:00 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:42:00 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] Deleted volume successfully. Jul 13 20:42:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a891998f-f139-4ad8-b145-70881c806e96 tempest-SnapshotDependencyTests-1363813625 None] Lock "cinder-d645842f-ebc8-4cd6-96fe-84759e184fa0-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:42:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] Acquiring lock "cinder-6fd80906-cdb9-4751-99c4-24c3fbdae93e-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:42:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] Lock "cinder-6fd80906-cdb9-4751-99c4-24c3fbdae93e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:42:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] Acquiring lock "cinder-quobyte-6fd80906-cdb9-4751-99c4-24c3fbdae93e" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:42:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] Lock "cinder-quobyte-6fd80906-cdb9-4751-99c4-24c3fbdae93e" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:42:01 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6201018-1363-4679-9815-b6ce6edb2c24]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:42:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-6fd80906-cdb9-4751-99c4-24c3fbdae93e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:42:01 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-6fd80906-cdb9-4751-99c4-24c3fbdae93e Jul 13 20:42:01 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:42:01 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Jul 13 20:42:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-6fd80906-cdb9-4751-99c4-24c3fbdae93e" returned: 0 in 0.427s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:42:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-6fd80906-cdb9-4751-99c4-24c3fbdae93e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:42:01 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-6fd80906-cdb9-4751-99c4-24c3fbdae93e Jul 13 20:42:01 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:42:01 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Jul 13 20:42:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-6fd80906-cdb9-4751-99c4-24c3fbdae93e" returned: 0 in 0.326s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:42:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] Lock "cinder-quobyte-6fd80906-cdb9-4751-99c4-24c3fbdae93e" released by "delete_volume" :: held 0.844s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:42:02 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] Created reservations ['157ecd41-1b82-444b-b682-d31229e48aef', '41103c78-bc72-48b8-83c6-143a2cb8a525', 'c3dbf3f1-9dfc-4916-937a-518fa161ff10', '4df5d2cd-0d56-4d67-a0a7-fc78c2bdc014'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:42:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:42:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:42:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:42:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:42:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:42:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:42:02 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:42:02 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:42:02 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Jul 13 20:42:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.354s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:42:02 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:42:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] Deleted volume successfully. Jul 13 20:42:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7132bf5e-0d9b-4c87-8005-e06918849e3c tempest-SnapshotDependencyTests-1363813625 None] Lock "cinder-6fd80906-cdb9-4751-99c4-24c3fbdae93e-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:42:12 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=32,cinder:INSERT=10,cinder:UPDATE=35,cinder:DELETE=2 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:42:12 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=38,cinder:SELECT=30,cinder:DELETE=4,cinder:INSERT=8 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:42:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:42:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:42:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:42:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:42:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:42:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:42:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:42:18 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:42:18 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:42:19 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Jul 13 20:42:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.287s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:42:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:42:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:42:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:42:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Flow 'volume_create_manager' (623506ce-10b6-40bb-bc54-4d8b45608c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b48d55-c719-4f66-9a47-4fab534c85a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b48d55-c719-4f66-9a47-4fab534c85a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-862566247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e642aec-d217-4e52-8dcd-f2d2189f9f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f199a111d1a243058c4b58a61cbc7c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:42:36Z,use_quota=True,user_id='c21c6e2a7e774b15af458a4f53826456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfba997-df40-4cec-8365-617def7f7209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfba997-df40-4cec-8365-617def7f7209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb1a86e-41b5-4124-85bf-29d3f9d8574f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb1a86e-41b5-4124-85bf-29d3f9d8574f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e642aec-d217-4e52-8dcd-f2d2189f9f6d', 'volume_name': 'volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522f7a8a-f145-499a-96aa-d85cda7c0fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522f7a8a-f145-499a-96aa-d85cda7c0fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26e1695-8d98-40c3-9f7c-b178a797e409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:42:35 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Volume 3e642aec-d217-4e52-8dcd-f2d2189f9f6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d', 'volume_size': 1} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-862566247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e642aec-d217-4e52-8dcd-f2d2189f9f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f199a111d1a243058c4b58a61cbc7c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:42:36Z,use_quota=True,user_id='c21c6e2a7e774b15af458a4f53826456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Creating volume 3e642aec-d217-4e52-8dcd-f2d2189f9f6d {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:42:35 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:42:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:42:35 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d 1073741824 Jul 13 20:42:35 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:42:36 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Jul 13 20:42:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d 1073741824" returned: 0 in 0.473s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:42:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:42:36 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d Jul 13 20:42:36 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:42:36 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Jul 13 20:42:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d" returned: 0 in 0.288s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:42:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:42:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:42:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26e1695-8d98-40c3-9f7c-b178a797e409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:42:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a092846c-d44f-4d67-8b79-ddf9335e9eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:42:36 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Volume volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d (3e642aec-d217-4e52-8dcd-f2d2189f9f6d): created successfully Jul 13 20:42:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a092846c-d44f-4d67-8b79-ddf9335e9eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:42:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Flow 'volume_create_manager' (623506ce-10b6-40bb-bc54-4d8b45608c31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:42:36 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-99647705-1fab-4dd4-867d-152b8bf1fe30 tempest-AttachVolumeNegativeTest-1019566619 None] Created volume successfully. Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Flow 'volume_create_manager' (2d3acca2-72fb-4c5c-a566-7b69b2af3dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44261da1-7ed1-4b12-b3dc-a7c1c546d1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44261da1-7ed1-4b12-b3dc-a7c1c546d1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-354684256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2087e6f-614f-4ff6-8a65-d4c13e67ba2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15902af48da34777ac80518e57fdcf70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:42:38Z,use_quota=True,user_id='ef74f27b20054af4a24cc1b14082b83b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966bc724-acd5-445a-abd5-9a6640874f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966bc724-acd5-445a-abd5-9a6640874f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cecce0c7-ebad-438f-943c-0d5a8f459890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cecce0c7-ebad-438f-943c-0d5a8f459890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2087e6f-614f-4ff6-8a65-d4c13e67ba2d', 'volume_name': 'volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55523a8c-f011-4fa9-bf96-536989a6cd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55523a8c-f011-4fa9-bf96-536989a6cd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b91be1-73b5-4710-b1e5-a91f7488ddaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:42:38 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Volume c2087e6f-614f-4ff6-8a65-d4c13e67ba2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d', 'volume_size': 1} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-354684256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2087e6f-614f-4ff6-8a65-d4c13e67ba2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15902af48da34777ac80518e57fdcf70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:42:38Z,use_quota=True,user_id='ef74f27b20054af4a24cc1b14082b83b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Creating volume c2087e6f-614f-4ff6-8a65-d4c13e67ba2d {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:42:38 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:42:38 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d 1073741824 Jul 13 20:42:38 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:42:38 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d 1073741824" returned: 0 in 0.542s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-01f15340-7dde-445b-a05a-69875a7d04d9 req-a16cdb46-851a-434a-b3fc-582e423166fb tempest-AttachVolumeNegativeTest-1019566619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:42:38 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d Jul 13 20:42:38 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:42:38 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d" returned: 0 in 0.258s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-01f15340-7dde-445b-a05a-69875a7d04d9 req-a16cdb46-851a-434a-b3fc-582e423166fb tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.267s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b91be1-73b5-4710-b1e5-a91f7488ddaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:42:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4149860-29b1-47be-a0e6-d40b5c05dbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:42:39 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[983703c8-cde2-485d-ae87-060ca41f778a]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:42:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-01f15340-7dde-445b-a05a-69875a7d04d9 req-a16cdb46-851a-434a-b3fc-582e423166fb tempest-AttachVolumeNegativeTest-1019566619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:42:39 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Volume volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d (c2087e6f-614f-4ff6-8a65-d4c13e67ba2d): created successfully Jul 13 20:42:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4149860-29b1-47be-a0e6-d40b5c05dbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:42:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Flow 'volume_create_manager' (2d3acca2-72fb-4c5c-a566-7b69b2af3dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:42:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a89019a8-7094-4b3c-8de3-f14aaac2b311 tempest-TestStampPattern-124054419 None] Created volume successfully. Jul 13 20:42:39 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d Jul 13 20:42:39 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:42:39 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Jul 13 20:42:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-01f15340-7dde-445b-a05a-69875a7d04d9 req-a16cdb46-851a-434a-b3fc-582e423166fb tempest-AttachVolumeNegativeTest-1019566619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d" returned: 0 in 0.403s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:42:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-01f15340-7dde-445b-a05a-69875a7d04d9 req-a16cdb46-851a-434a-b3fc-582e423166fb tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.434s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:42:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-01f15340-7dde-445b-a05a-69875a7d04d9 req-a16cdb46-851a-434a-b3fc-582e423166fb tempest-AttachVolumeNegativeTest-1019566619 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c243b13f-cd27-48b9-a61f-0b71cee3bed3', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:42:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-01f15340-7dde-445b-a05a-69875a7d04d9 req-a16cdb46-851a-434a-b3fc-582e423166fb tempest-AttachVolumeNegativeTest-1019566619 None] attachment_update completed successfully. Jul 13 20:42:41 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-5a9f6aa1-338f-499f-bb8d-51e7a192c225 req-24a5ef67-20fa-4a2e-bcc2-1791d0e81846 tempest-AttachVolumeNegativeTest-1019566619 None] Terminate volume connection completed successfully. Jul 13 20:42:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-5a9f6aa1-338f-499f-bb8d-51e7a192c225 req-24a5ef67-20fa-4a2e-bcc2-1791d0e81846 tempest-AttachVolumeNegativeTest-1019566619 None] Deleting attachment c243b13f-cd27-48b9-a61f-0b71cee3bed3. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:42:49 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:42:51 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=12,cinder:UPDATE=10 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:43:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-3dcb22a3-bd38-4141-9fcc-1015b90df455 req-b957b597-cb73-4a06-8b58-89a9f162d8d8 tempest-TestStampPattern-124054419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-3dcb22a3-bd38-4141-9fcc-1015b90df455 req-b957b597-cb73-4a06-8b58-89a9f162d8d8 tempest-TestStampPattern-124054419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:09 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe429f9-d5a3-429a-8007-9b456af783aa]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:43:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-3dcb22a3-bd38-4141-9fcc-1015b90df455 req-b957b597-cb73-4a06-8b58-89a9f162d8d8 tempest-TestStampPattern-124054419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:09 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d Jul 13 20:43:09 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:10 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-3dcb22a3-bd38-4141-9fcc-1015b90df455 req-b957b597-cb73-4a06-8b58-89a9f162d8d8 tempest-TestStampPattern-124054419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d" returned: 0 in 0.344s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-3dcb22a3-bd38-4141-9fcc-1015b90df455 req-b957b597-cb73-4a06-8b58-89a9f162d8d8 tempest-TestStampPattern-124054419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.361s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-3dcb22a3-bd38-4141-9fcc-1015b90df455 req-b957b597-cb73-4a06-8b58-89a9f162d8d8 tempest-TestStampPattern-124054419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3154e3b6-b1e3-40b9-a6fa-c54e12d652eb', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:43:10 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-3dcb22a3-bd38-4141-9fcc-1015b90df455 req-b957b597-cb73-4a06-8b58-89a9f162d8d8 tempest-TestStampPattern-124054419 None] attachment_update completed successfully. Jul 13 20:43:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-446cf1e8-456b-4072-ac12-a43bf2944b70 req-4fbf4f07-83f3-498e-9962-6e9664c051e9 tempest-TestStampPattern-124054419 None] Terminate volume connection completed successfully. Jul 13 20:43:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-446cf1e8-456b-4072-ac12-a43bf2944b70 req-4fbf4f07-83f3-498e-9962-6e9664c051e9 tempest-TestStampPattern-124054419 None] Deleting attachment 3154e3b6-b1e3-40b9-a6fa-c54e12d652eb. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:43:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d1db1f81-78ce-4441-8939-8fac05e6c44b tempest-TestStampPattern-124054419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d1db1f81-78ce-4441-8939-8fac05e6c44b tempest-TestStampPattern-124054419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d1db1f81-78ce-4441-8939-8fac05e6c44b tempest-TestStampPattern-124054419 None] Creating offline snapshot 9ae0108d-788c-4956-a301-d28a6afa1b74 of volume c2087e6f-614f-4ff6-8a65-d4c13e67ba2d {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:43:15 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5af9c96-6a08-4b4e-abb1-8a5fe0166057]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:43:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d1db1f81-78ce-4441-8939-8fac05e6c44b tempest-TestStampPattern-124054419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:15 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d Jul 13 20:43:15 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:16 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d1db1f81-78ce-4441-8939-8fac05e6c44b tempest-TestStampPattern-124054419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d" returned: 0 in 0.381s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d1db1f81-78ce-4441-8939-8fac05e6c44b tempest-TestStampPattern-124054419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:16 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74 1G Jul 13 20:43:16 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:16 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d1db1f81-78ce-4441-8939-8fac05e6c44b tempest-TestStampPattern-124054419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74 1G" returned: 0 in 0.395s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d1db1f81-78ce-4441-8939-8fac05e6c44b tempest-TestStampPattern-124054419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:16 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74 Jul 13 20:43:16 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:16 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d1db1f81-78ce-4441-8939-8fac05e6c44b tempest-TestStampPattern-124054419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74" returned: 0 in 0.275s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:16 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-d1db1f81-78ce-4441-8939-8fac05e6c44b tempest-TestStampPattern-124054419 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74 is being set with open permissions: ugo+rw Jul 13 20:43:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d1db1f81-78ce-4441-8939-8fac05e6c44b tempest-TestStampPattern-124054419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:16 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74 Jul 13 20:43:16 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:16 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d1db1f81-78ce-4441-8939-8fac05e6c44b tempest-TestStampPattern-124054419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74" returned: 0 in 0.239s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d1db1f81-78ce-4441-8939-8fac05e6c44b tempest-TestStampPattern-124054419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:17 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.info Jul 13 20:43:17 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:17 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d1db1f81-78ce-4441-8939-8fac05e6c44b tempest-TestStampPattern-124054419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.info" returned: 0 in 0.258s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:17 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-d1db1f81-78ce-4441-8939-8fac05e6c44b tempest-TestStampPattern-124054419 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.info is being set with open permissions: ugo+rw Jul 13 20:43:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d1db1f81-78ce-4441-8939-8fac05e6c44b tempest-TestStampPattern-124054419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:17 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.info Jul 13 20:43:17 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:17 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d1db1f81-78ce-4441-8939-8fac05e6c44b tempest-TestStampPattern-124054419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.info" returned: 0 in 0.238s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d1db1f81-78ce-4441-8939-8fac05e6c44b tempest-TestStampPattern-124054419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d1db1f81-78ce-4441-8939-8fac05e6c44b tempest-TestStampPattern-124054419 None] Create snapshot completed successfully Jul 13 20:43:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:43:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:43:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:43:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:18 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:43:18 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:19 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.339s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Flow 'volume_create_manager' (9948f7a5-9c17-4f19-9573-863890ab08c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d63d69-95ff-4c39-a321-1574d4cdc5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d63d69-95ff-4c39-a321-1574d4cdc5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-369798066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974f2925-220e-4fe1-93ac-a3334f505304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f199a111d1a243058c4b58a61cbc7c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:43:19Z,use_quota=True,user_id='c21c6e2a7e774b15af458a4f53826456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5031662-7ef5-48e4-80ca-0c16a790e6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5031662-7ef5-48e4-80ca-0c16a790e6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581c9742-c92c-4540-9e8c-117202da220c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581c9742-c92c-4540-9e8c-117202da220c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '974f2925-220e-4fe1-93ac-a3334f505304', 'volume_name': 'volume-974f2925-220e-4fe1-93ac-a3334f505304', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a509359-8c81-4e7a-8727-fb0d25e3add8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a509359-8c81-4e7a-8727-fb0d25e3add8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513270fd-475f-4416-9860-9664ec654d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:19 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Volume 974f2925-220e-4fe1-93ac-a3334f505304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-974f2925-220e-4fe1-93ac-a3334f505304', 'volume_size': 1} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-369798066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974f2925-220e-4fe1-93ac-a3334f505304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f199a111d1a243058c4b58a61cbc7c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:43:19Z,use_quota=True,user_id='c21c6e2a7e774b15af458a4f53826456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Creating volume 974f2925-220e-4fe1-93ac-a3334f505304 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:43:19 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-974f2925-220e-4fe1-93ac-a3334f505304 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:19 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-974f2925-220e-4fe1-93ac-a3334f505304 1073741824 Jul 13 20:43:19 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:19 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-974f2925-220e-4fe1-93ac-a3334f505304 1073741824" returned: 0 in 0.462s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-974f2925-220e-4fe1-93ac-a3334f505304 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:19 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-974f2925-220e-4fe1-93ac-a3334f505304 Jul 13 20:43:19 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:20 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-974f2925-220e-4fe1-93ac-a3334f505304" returned: 0 in 0.247s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:43:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513270fd-475f-4416-9860-9664ec654d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-974f2925-220e-4fe1-93ac-a3334f505304', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784383f6-9b86-4cf1-b0ea-b897a090078c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:20 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Volume volume-974f2925-220e-4fe1-93ac-a3334f505304 (974f2925-220e-4fe1-93ac-a3334f505304): created successfully Jul 13 20:43:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784383f6-9b86-4cf1-b0ea-b897a090078c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Flow 'volume_create_manager' (9948f7a5-9c17-4f19-9573-863890ab08c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:43:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b3be85bb-3bf7-4435-91ec-20c8c16b014a tempest-AttachVolumeNegativeTest-1019566619 None] Created volume successfully. Jul 13 20:43:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a7ad2018-1ca2-4e7a-aac4-665bd0fb4221 req-299f6c0c-9aef-4d78-9a54-7e6b4f047c70 tempest-AttachVolumeNegativeTest-1019566619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a7ad2018-1ca2-4e7a-aac4-665bd0fb4221 req-299f6c0c-9aef-4d78-9a54-7e6b4f047c70 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[359f07bd-1f79-4de8-9607-ce25ab8d97e4]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:43:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-a7ad2018-1ca2-4e7a-aac4-665bd0fb4221 req-299f6c0c-9aef-4d78-9a54-7e6b4f047c70 tempest-AttachVolumeNegativeTest-1019566619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-974f2925-220e-4fe1-93ac-a3334f505304 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:21 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-974f2925-220e-4fe1-93ac-a3334f505304 Jul 13 20:43:21 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:21 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-a7ad2018-1ca2-4e7a-aac4-665bd0fb4221 req-299f6c0c-9aef-4d78-9a54-7e6b4f047c70 tempest-AttachVolumeNegativeTest-1019566619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-974f2925-220e-4fe1-93ac-a3334f505304" returned: 0 in 0.377s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a7ad2018-1ca2-4e7a-aac4-665bd0fb4221 req-299f6c0c-9aef-4d78-9a54-7e6b4f047c70 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.395s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a7ad2018-1ca2-4e7a-aac4-665bd0fb4221 req-299f6c0c-9aef-4d78-9a54-7e6b4f047c70 tempest-AttachVolumeNegativeTest-1019566619 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-974f2925-220e-4fe1-93ac-a3334f505304', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '168c53e5-6d5a-4f14-b3c6-8081ff723ed7', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:43:21 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-a7ad2018-1ca2-4e7a-aac4-665bd0fb4221 req-299f6c0c-9aef-4d78-9a54-7e6b4f047c70 tempest-AttachVolumeNegativeTest-1019566619 None] attachment_update completed successfully. Jul 13 20:43:23 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-2e76a007-c75c-41c6-a9bc-c1005485e8a5 req-da8e4031-7b8d-41ab-ba0a-b38fd85cb32c tempest-AttachVolumeNegativeTest-1019566619 None] Terminate volume connection completed successfully. Jul 13 20:43:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-2e76a007-c75c-41c6-a9bc-c1005485e8a5 req-da8e4031-7b8d-41ab-ba0a-b38fd85cb32c tempest-AttachVolumeNegativeTest-1019566619 None] Deleting attachment 168c53e5-6d5a-4f14-b3c6-8081ff723ed7. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Flow 'volume_create_manager' (11a247fb-e9de-47b8-a4f7-44cea43881f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16da2bc9-4ff5-4cd7-9b3f-f4e770b8bc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16da2bc9-4ff5-4cd7-9b3f-f4e770b8bc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-119587866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eff609c-51a1-4a4c-8f25-88488276dc48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15902af48da34777ac80518e57fdcf70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9ae0108d-788c-4956-a301-d28a6afa1b74,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:43:24Z,use_quota=True,user_id='ef74f27b20054af4a24cc1b14082b83b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9535e842-7f62-4fa0-89b5-c82c8b2c01de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9535e842-7f62-4fa0-89b5-c82c8b2c01de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e303405d-3f41-43e5-abde-b5fbb6ee2f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e303405d-3f41-43e5-abde-b5fbb6ee2f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3eff609c-51a1-4a4c-8f25-88488276dc48', 'volume_name': 'volume-3eff609c-51a1-4a4c-8f25-88488276dc48', 'volume_size': 1, 'snapshot_id': '9ae0108d-788c-4956-a301-d28a6afa1b74'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a57ee7-b006-4846-af83-d2631d0cd535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a57ee7-b006-4846-af83-d2631d0cd535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faad3986-aa84-4cbe-b3cf-251134d01049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:24 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Volume 3eff609c-51a1-4a4c-8f25-88488276dc48: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3eff609c-51a1-4a4c-8f25-88488276dc48', 'volume_size': 1, 'snapshot_id': '9ae0108d-788c-4956-a301-d28a6afa1b74'} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Acquiring lock "cinder-quobyte-9ae0108d-788c-4956-a301-d28a6afa1b74-3eff609c-51a1-4a4c-8f25-88488276dc48" by "_create_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Lock "cinder-quobyte-9ae0108d-788c-4956-a301-d28a6afa1b74-3eff609c-51a1-4a4c-8f25-88488276dc48" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Creating volume 3eff609c-51a1-4a4c-8f25-88488276dc48 from snapshot 9ae0108d-788c-4956-a301-d28a6afa1b74 {{(pid=87269) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Acquiring lock "cinder-quobyte-3eff609c-51a1-4a4c-8f25-88488276dc48" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Lock "cinder-quobyte-3eff609c-51a1-4a4c-8f25-88488276dc48" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] snapshot: 9ae0108d-788c-4956-a301-d28a6afa1b74, volume: 3eff609c-51a1-4a4c-8f25-88488276dc48, {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d94c66-55e1-45f4-a2b7-080e82e550b1]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:24 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74 Jul 13 20:43:24 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:24 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74" returned: 0 in 0.428s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[404a452b-4142-4c87-9860-3994a909feb2]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:43:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:25 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d Jul 13 20:43:25 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:25 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d" returned: 0 in 0.580s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:25 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Path /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3eff609c-51a1-4a4c-8f25-88488276dc48 not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 20:43:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3eff609c-51a1-4a4c-8f25-88488276dc48 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:25 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3eff609c-51a1-4a4c-8f25-88488276dc48 Jul 13 20:43:25 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:31 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3eff609c-51a1-4a4c-8f25-88488276dc48" returned: 0 in 6.307s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:31 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce25c23-f17f-4d3f-8271-829728fca320]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:43:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:32 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d Jul 13 20:43:32 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:32 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d" returned: 0 in 0.687s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:32 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d, size 1024.00 MB, duration 6.31 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3eff609c-51a1-4a4c-8f25-88488276dc48 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:43:32 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Converted 1024.00 MB image at 162.32 MB/s Jul 13 20:43:32 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3eff609c-51a1-4a4c-8f25-88488276dc48 is being set with open permissions: ugo+rw Jul 13 20:43:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3eff609c-51a1-4a4c-8f25-88488276dc48 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] Acquiring lock "cinder-974f2925-220e-4fe1-93ac-a3334f505304-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:43:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "cinder-974f2925-220e-4fe1-93ac-a3334f505304-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:43:32 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3eff609c-51a1-4a4c-8f25-88488276dc48 Jul 13 20:43:32 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] Acquiring lock "cinder-quobyte-974f2925-220e-4fe1-93ac-a3334f505304" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:43:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "cinder-quobyte-974f2925-220e-4fe1-93ac-a3334f505304" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:43:32 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde18858-6bf3-4c33-9d94-9bfdad698b6a]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:43:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-974f2925-220e-4fe1-93ac-a3334f505304 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:32 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-974f2925-220e-4fe1-93ac-a3334f505304 Jul 13 20:43:32 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:32 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3eff609c-51a1-4a4c-8f25-88488276dc48" returned: 0 in 0.344s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Lock "cinder-quobyte-3eff609c-51a1-4a4c-8f25-88488276dc48" released by "_copy_volume_from_snapshot" :: held 8.466s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:43:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Lock "cinder-quobyte-9ae0108d-788c-4956-a301-d28a6afa1b74-3eff609c-51a1-4a4c-8f25-88488276dc48" released by "_create_volume_from_snapshot" :: held 8.507s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:43:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.526s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faad3986-aa84-4cbe-b3cf-251134d01049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eff609c-51a1-4a4c-8f25-88488276dc48', 'volume_size': 1, 'snapshot_id': '9ae0108d-788c-4956-a301-d28a6afa1b74'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca70bd8-79d3-494f-ad30-f788e8b71d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:33 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Volume volume-3eff609c-51a1-4a4c-8f25-88488276dc48 (3eff609c-51a1-4a4c-8f25-88488276dc48): created successfully Jul 13 20:43:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca70bd8-79d3-494f-ad30-f788e8b71d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Flow 'volume_create_manager' (11a247fb-e9de-47b8-a4f7-44cea43881f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:43:33 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9d12de80-849f-46eb-aa51-f0c8d51b00b1 tempest-TestStampPattern-124054419 None] Created volume successfully. Jul 13 20:43:33 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-974f2925-220e-4fe1-93ac-a3334f505304" returned: 0 in 0.463s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-974f2925-220e-4fe1-93ac-a3334f505304 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:33 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-974f2925-220e-4fe1-93ac-a3334f505304 Jul 13 20:43:33 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:33 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-974f2925-220e-4fe1-93ac-a3334f505304" returned: 0 in 0.372s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "cinder-quobyte-974f2925-220e-4fe1-93ac-a3334f505304" released by "delete_volume" :: held 0.888s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:43:33 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] Created reservations ['fb71f937-086c-484f-94ce-f1b4d92f777c', 'c8939095-391e-4fc1-b164-ecd2cc7a692f', '0fec7189-c8eb-481f-8728-a3d3836f7969', 'f42ac16e-47ee-4dde-a4aa-c3403b6777ac'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:43:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:43:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:43:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:33 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:43:33 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] Acquiring lock "cinder-3e642aec-d217-4e52-8dcd-f2d2189f9f6d-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:43:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "cinder-3e642aec-d217-4e52-8dcd-f2d2189f9f6d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:43:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] Acquiring lock "cinder-quobyte-3e642aec-d217-4e52-8dcd-f2d2189f9f6d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:43:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "cinder-quobyte-3e642aec-d217-4e52-8dcd-f2d2189f9f6d" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:43:34 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.415s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:34 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:43:34 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] Deleted volume successfully. Jul 13 20:43:34 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d196882-9fca-40a9-8a3d-d8b7891e3bd0]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:43:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-99f6c28b-f048-49da-8317-a63b4f750628 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "cinder-974f2925-220e-4fe1-93ac-a3334f505304-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:43:34 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d Jul 13 20:43:34 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:34 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d" returned: 0 in 0.456s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:34 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d Jul 13 20:43:34 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:35 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3e642aec-d217-4e52-8dcd-f2d2189f9f6d" returned: 0 in 0.359s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "cinder-quobyte-3e642aec-d217-4e52-8dcd-f2d2189f9f6d" released by "delete_volume" :: held 0.890s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:43:35 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] Created reservations ['6f3e84ef-fed4-4e69-bc2f-e0b37ed273a4', '921c029a-4fca-495c-9c87-dc81995bb448', '682938b4-1c12-4ae8-bcf6-503b777c1fa1', '6449ecab-cba3-4b16-8171-76c0cba63728'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:43:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:43:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:43:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:35 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:43:35 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:35 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.263s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:35 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:43:35 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] Deleted volume successfully. Jul 13 20:43:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-99a690dc-e482-4c3d-b178-647f20ba07e7 tempest-AttachVolumeNegativeTest-1019566619 None] Lock "cinder-3e642aec-d217-4e52-8dcd-f2d2189f9f6d-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:43:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] Acquiring lock "cinder-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:43:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] Lock "cinder-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:43:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] Acquiring lock "cinder-quobyte-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:43:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] Lock "cinder-quobyte-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:43:36 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fef9eb-6bb8-4408-8786-38ebd6f13b3f]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:43:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:36 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc Jul 13 20:43:36 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:37 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc" returned: 0 in 0.431s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:37 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc Jul 13 20:43:37 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:37 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc" returned: 0 in 0.285s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] Lock "cinder-quobyte-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc" released by "delete_volume" :: held 0.769s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:43:37 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] Created reservations ['d37f1bcf-6ab8-42ed-b7c0-eb67ec6210f6', '0ac7f774-675d-48be-bb2a-3ca4fd3a9414', '2aa638bf-b2d1-4603-95ad-82836d42deb7', 'e702e8e5-a479-4976-a8c7-6eabd948642d'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:43:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:43:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:43:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:37 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:43:37 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:37 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.301s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:37 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:43:37 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] Deleted volume successfully. Jul 13 20:43:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cd6855fc-0eb9-4a31-b6f0-d764a657970f tempest-AttachVolumeNegativeTest-1019566619 None] Lock "cinder-90434f1b-d6ce-4dbe-8ea8-360eeb1e85fc-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:43:44 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:43:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Flow 'volume_create_manager' (690f111f-4bfe-4a20-8d6a-3c3ed5b055e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:43:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4b0ff9-fb79-446c-a09a-faf1d4912f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4b0ff9-fb79-446c-a09a-faf1d4912f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1434147459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f6c8e2-e6b4-42ab-b41b-266a9ba59b30,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d126b016789a40299623895dafd5103f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:43:45Z,use_quota=True,user_id='1df3b673b5cb454db7bff1169e17c032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd053e2b-fa7f-4cf0-9749-af94da4df681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd053e2b-fa7f-4cf0-9749-af94da4df681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3abd873-3f53-4fe6-a215-1e09ffc06541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3abd873-3f53-4fe6-a215-1e09ffc06541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32f6c8e2-e6b4-42ab-b41b-266a9ba59b30', 'volume_name': 'volume-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a94e2b-199d-4f0c-94a0-43b9cfec0ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a94e2b-199d-4f0c-94a0-43b9cfec0ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f67225-0148-469c-b115-220cedc307a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:45 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Volume 32f6c8e2-e6b4-42ab-b41b-266a9ba59b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30', 'volume_size': 1} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1434147459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f6c8e2-e6b4-42ab-b41b-266a9ba59b30,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d126b016789a40299623895dafd5103f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:43:45Z,use_quota=True,user_id='1df3b673b5cb454db7bff1169e17c032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Creating volume 32f6c8e2-e6b4-42ab-b41b-266a9ba59b30 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:43:45 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:45 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30 1073741824 Jul 13 20:43:45 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:45 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30 1073741824" returned: 0 in 0.427s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:45 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30 Jul 13 20:43:45 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:45 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30" returned: 0 in 0.253s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f67225-0148-469c-b115-220cedc307a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb86aff4-f172-440a-9d76-0295b4e9135f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:45 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Volume volume-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30 (32f6c8e2-e6b4-42ab-b41b-266a9ba59b30): created successfully Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb86aff4-f172-440a-9d76-0295b4e9135f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Flow 'volume_create_manager' (690f111f-4bfe-4a20-8d6a-3c3ed5b055e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:43:45 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6f990fc6-73a3-47a2-b29d-d22559191e22 tempest-VolumesTestJSON-1143858841 None] Created volume successfully. Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Flow 'volume_create_manager' (f360aa20-c31a-4af8-aef2-ed19ef839f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58b3f45-150d-4f8c-bf81-66051bc490b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58b3f45-150d-4f8c-bf81-66051bc490b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1330065843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=369845b8-4cb5-4615-aca1-3e296fc712f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d126b016789a40299623895dafd5103f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:43:46Z,use_quota=True,user_id='1df3b673b5cb454db7bff1169e17c032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138e750c-ee8a-4323-a4ba-1ec1cbe23d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138e750c-ee8a-4323-a4ba-1ec1cbe23d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8bef192-d7c4-4d4d-9e04-24b89e854efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8bef192-d7c4-4d4d-9e04-24b89e854efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '369845b8-4cb5-4615-aca1-3e296fc712f1', 'volume_name': 'volume-369845b8-4cb5-4615-aca1-3e296fc712f1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ccdd27-26d1-40cb-ae6f-8fcf36d3a8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ccdd27-26d1-40cb-ae6f-8fcf36d3a8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85913b38-3946-46dc-8e7b-b70bf9ba8421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:46 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Volume 369845b8-4cb5-4615-aca1-3e296fc712f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-369845b8-4cb5-4615-aca1-3e296fc712f1', 'volume_size': 1} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1330065843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=369845b8-4cb5-4615-aca1-3e296fc712f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d126b016789a40299623895dafd5103f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:43:46Z,use_quota=True,user_id='1df3b673b5cb454db7bff1169e17c032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Creating volume 369845b8-4cb5-4615-aca1-3e296fc712f1 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:43:46 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-369845b8-4cb5-4615-aca1-3e296fc712f1 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:46 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-369845b8-4cb5-4615-aca1-3e296fc712f1 1073741824 Jul 13 20:43:46 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:46 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-369845b8-4cb5-4615-aca1-3e296fc712f1 1073741824" returned: 0 in 0.427s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-369845b8-4cb5-4615-aca1-3e296fc712f1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:47 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-369845b8-4cb5-4615-aca1-3e296fc712f1 Jul 13 20:43:47 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:47 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-369845b8-4cb5-4615-aca1-3e296fc712f1" returned: 0 in 0.281s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:43:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85913b38-3946-46dc-8e7b-b70bf9ba8421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-369845b8-4cb5-4615-aca1-3e296fc712f1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca4558c-e513-4a2a-832b-6e7253b5d8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:47 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Volume volume-369845b8-4cb5-4615-aca1-3e296fc712f1 (369845b8-4cb5-4615-aca1-3e296fc712f1): created successfully Jul 13 20:43:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca4558c-e513-4a2a-832b-6e7253b5d8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Flow 'volume_create_manager' (f360aa20-c31a-4af8-aef2-ed19ef839f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:43:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a9600af0-410b-489b-85ac-4af1526be410 tempest-VolumesTestJSON-1143858841 None] Created volume successfully. Jul 13 20:43:47 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:43:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Flow 'volume_create_manager' (ecf8fc65-c792-4478-9f9d-f76756a99613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddedc0e-9fa6-4c70-8dec-3507361cc4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddedc0e-9fa6-4c70-8dec-3507361cc4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1265825623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d126b016789a40299623895dafd5103f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:43:48Z,use_quota=True,user_id='1df3b673b5cb454db7bff1169e17c032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fb624b-69b4-4836-8c24-145ecaef77b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fb624b-69b4-4836-8c24-145ecaef77b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78ebdb1-4eb0-4110-8b68-5771c8b67b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78ebdb1-4eb0-4110-8b68-5771c8b67b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e', 'volume_name': 'volume-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b272e2a-b8cf-4d2e-9da7-6b66760ca76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b272e2a-b8cf-4d2e-9da7-6b66760ca76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c73097-689c-4ac7-8e2c-2a6324d3e199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:48 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Volume 7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e', 'volume_size': 1} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1265825623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d126b016789a40299623895dafd5103f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:43:48Z,use_quota=True,user_id='1df3b673b5cb454db7bff1169e17c032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Creating volume 7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:43:48 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:48 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e 1073741824 Jul 13 20:43:48 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:48 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e 1073741824" returned: 0 in 0.451s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:48 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e Jul 13 20:43:48 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:48 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e" returned: 0 in 0.265s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c73097-689c-4ac7-8e2c-2a6324d3e199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a0d0516-9037-4571-b250-25a58da6e6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:43:48 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Volume volume-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e (7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e): created successfully Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a0d0516-9037-4571-b250-25a58da6e6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:43:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Flow 'volume_create_manager' (ecf8fc65-c792-4478-9f9d-f76756a99613) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:43:48 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-feb5814e-c877-4f67-9d56-9db03589d586 tempest-VolumesTestJSON-1143858841 None] Created volume successfully. Jul 13 20:43:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] Acquiring lock "cinder-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:43:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] Lock "cinder-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:43:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] Acquiring lock "cinder-quobyte-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:43:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] Lock "cinder-quobyte-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:43:50 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b742f1f5-7ad4-49c7-bd7e-620b597aed88]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:43:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:50 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e Jul 13 20:43:50 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:51 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e" returned: 0 in 0.358s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:51 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e Jul 13 20:43:51 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:51 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e" returned: 0 in 0.249s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] Lock "cinder-quobyte-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e" released by "delete_volume" :: held 0.644s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:43:51 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] Created reservations ['2ba9df83-edb1-4fcd-9fad-3e0ec81a1c52', 'f6cb5576-058d-42f9-921b-e2f1939f2977', 'bc4e9633-2f9b-43a2-9a35-6d1ca4860678', '436cb6e3-fb16-427a-9758-43659f7df8cd'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:43:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:43:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:43:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:51 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:43:51 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:51 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.250s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:51 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:43:51 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] Deleted volume successfully. Jul 13 20:43:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-fa41b1a8-1635-4139-8e7e-6c5d49166c08 tempest-VolumesTestJSON-1143858841 None] Lock "cinder-7c2f26d7-04f8-47c6-bbf8-55cc0bc6da5e-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:43:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] Acquiring lock "cinder-369845b8-4cb5-4615-aca1-3e296fc712f1-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:43:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] Lock "cinder-369845b8-4cb5-4615-aca1-3e296fc712f1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:43:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] Acquiring lock "cinder-quobyte-369845b8-4cb5-4615-aca1-3e296fc712f1" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:43:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] Lock "cinder-quobyte-369845b8-4cb5-4615-aca1-3e296fc712f1" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:43:52 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d51af70-8063-4d56-b383-b039b23a29e4]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:43:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-369845b8-4cb5-4615-aca1-3e296fc712f1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:52 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-369845b8-4cb5-4615-aca1-3e296fc712f1 Jul 13 20:43:52 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:52 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-369845b8-4cb5-4615-aca1-3e296fc712f1" returned: 0 in 0.365s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-369845b8-4cb5-4615-aca1-3e296fc712f1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:52 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-369845b8-4cb5-4615-aca1-3e296fc712f1 Jul 13 20:43:52 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:52 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-369845b8-4cb5-4615-aca1-3e296fc712f1" returned: 0 in 0.241s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] Lock "cinder-quobyte-369845b8-4cb5-4615-aca1-3e296fc712f1" released by "delete_volume" :: held 0.656s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:43:52 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] Created reservations ['fbd10053-e689-4d51-a73c-bed8c19967f0', 'd7b9e7e6-115d-4600-a14f-814f00d3906e', '054c98c7-6eb2-4aad-b6de-6fbbb8918535', '36c05196-2a76-4cf9-b5f7-21294a33f569'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:43:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:43:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:43:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:52 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:43:52 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:53 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.242s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:43:53 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] Deleted volume successfully. Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0f2522de-3446-4796-8b36-146a1cfe2bcc tempest-VolumesTestJSON-1143858841 None] Lock "cinder-369845b8-4cb5-4615-aca1-3e296fc712f1-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] Acquiring lock "cinder-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] Lock "cinder-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] Acquiring lock "cinder-quobyte-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] Lock "cinder-quobyte-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b3c7c0-cb20-4ecc-92ed-8d29a2e43e50]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:53 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30 Jul 13 20:43:53 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:53 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30" returned: 0 in 0.363s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:53 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30 Jul 13 20:43:53 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:53 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30" returned: 0 in 0.243s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] Lock "cinder-quobyte-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30" released by "delete_volume" :: held 0.645s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] Created reservations ['807b3a22-02cd-4fd5-9c12-54b06fbc09e4', 'ee3a79a5-b84f-44dd-a462-798bb4059913', '141dd83f-4407-4b37-bfe3-6f69b507e421', '9d9580ea-5f36-48bb-81d4-148601888d4b'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:43:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:43:53 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:43:53 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:43:54 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Jul 13 20:43:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.241s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:43:54 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:43:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] Deleted volume successfully. Jul 13 20:43:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cf9ccdc7-de41-4fe2-8680-5844bd9458e4 tempest-VolumesTestJSON-1143858841 None] Lock "cinder-32f6c8e2-e6b4-42ab-b41b-266a9ba59b30-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:43:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6a3e2338-831d-4228-8c01-779a7248fc2b tempest-BackendsCapabilitiesAdminTestsJSON-929465858 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87269) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 13 20:43:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b44b36a9-fae1-4cef-bd6c-2fd054b8c8ae tempest-BackendsCapabilitiesAdminTestsJSON-929465858 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87269) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 13 20:44:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2ed12e7e-394b-464a-8010-4457fac1d9a7 tempest-GroupsTest-428546884 None] Group tempest-Group1-1593939391: creating Jul 13 20:44:02 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=64,cinder:UPDATE=67,cinder:INSERT=13,cinder:DELETE=7 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:44:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2ed12e7e-394b-464a-8010-4457fac1d9a7 tempest-GroupsTest-428546884 None] Group tempest-Group1-1593939391: created successfully Jul 13 20:44:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2ed12e7e-394b-464a-8010-4457fac1d9a7 tempest-GroupsTest-428546884 None] Create group completed successfully. Jul 13 20:44:03 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a9f9e0f8-177d-4265-80fd-97f647a37891 tempest-GroupsTest-428546884 None] Group tempest-Group2-2037860651: creating Jul 13 20:44:03 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a9f9e0f8-177d-4265-80fd-97f647a37891 tempest-GroupsTest-428546884 None] Group tempest-Group2-2037860651: created successfully Jul 13 20:44:03 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a9f9e0f8-177d-4265-80fd-97f647a37891 tempest-GroupsTest-428546884 None] Create group completed successfully. Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Flow 'volume_create_manager' (c514330e-2c69-4116-8959-70b367fb9df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7f8087-c236-4725-8e12-689440ffd49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7f8087-c236-4725-8e12-689440ffd49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-762563418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56f5c7cb-e9bf-4b54-a9fc-1d83f4973246,host='devstack@QuobyteHD#QuobyteHD',id=622da146-d969-4459-8786-38923cee181d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a022044b584a599e5567ab5e8eff17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:05Z,use_quota=True,user_id='39969d8966c644f08f2ac761ad942206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62a0d747-d0de-452a-9edf-873b7fa798af),volume_type_id=62a0d747-d0de-452a-9edf-873b7fa798af)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ca1b81-d54f-400c-b974-8c04c8cee25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ca1b81-d54f-400c-b974-8c04c8cee25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce3726b-f17a-4f37-9d06-0d584848eb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce3726b-f17a-4f37-9d06-0d584848eb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '622da146-d969-4459-8786-38923cee181d', 'volume_name': 'volume-622da146-d969-4459-8786-38923cee181d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a79a5ba-0d02-48ee-a819-b845956f90a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a79a5ba-0d02-48ee-a819-b845956f90a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245bfbb6-735d-43f5-8491-6c4bb9df9342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Volume 622da146-d969-4459-8786-38923cee181d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-622da146-d969-4459-8786-38923cee181d', 'volume_size': 1} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=56f5c7cb-e9bf-4b54-a9fc-1d83f4973246,created_at=2026-07-13T18:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-762563418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56f5c7cb-e9bf-4b54-a9fc-1d83f4973246,host='devstack@QuobyteHD#QuobyteHD',id=622da146-d969-4459-8786-38923cee181d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a022044b584a599e5567ab5e8eff17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:05Z,use_quota=True,user_id='39969d8966c644f08f2ac761ad942206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62a0d747-d0de-452a-9edf-873b7fa798af),volume_type_id=62a0d747-d0de-452a-9edf-873b7fa798af)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Creating volume 622da146-d969-4459-8786-38923cee181d {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:44:04 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:44:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-622da146-d969-4459-8786-38923cee181d 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:05 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-622da146-d969-4459-8786-38923cee181d 1073741824 Jul 13 20:44:05 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:05 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-622da146-d969-4459-8786-38923cee181d 1073741824" returned: 0 in 0.421s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-622da146-d969-4459-8786-38923cee181d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:05 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-622da146-d969-4459-8786-38923cee181d Jul 13 20:44:05 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:05 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-622da146-d969-4459-8786-38923cee181d" returned: 0 in 0.256s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:44:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245bfbb6-735d-43f5-8491-6c4bb9df9342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-622da146-d969-4459-8786-38923cee181d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8559c280-a849-40d7-abf8-1b79fc9dad92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Volume volume-622da146-d969-4459-8786-38923cee181d (622da146-d969-4459-8786-38923cee181d): created successfully Jul 13 20:44:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8559c280-a849-40d7-abf8-1b79fc9dad92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Flow 'volume_create_manager' (c514330e-2c69-4116-8959-70b367fb9df3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f8676ce4-6b82-4c10-a335-9c896770e525 tempest-GroupsTest-428546884 None] Created volume successfully. Jul 13 20:44:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] Acquiring lock "cinder-quobyte-622da146-d969-4459-8786-38923cee181d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] Lock "cinder-quobyte-622da146-d969-4459-8786-38923cee181d" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:06 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a42e59-2f8a-4a00-9cd1-651e53eaaaf3]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-622da146-d969-4459-8786-38923cee181d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:06 devstack sudo[101935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-622da146-d969-4459-8786-38923cee181d Jul 13 20:44:06 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:07 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-622da146-d969-4459-8786-38923cee181d" returned: 0 in 0.362s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-622da146-d969-4459-8786-38923cee181d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:07 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-622da146-d969-4459-8786-38923cee181d Jul 13 20:44:07 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:07 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-622da146-d969-4459-8786-38923cee181d" returned: 0 in 0.242s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] Lock "cinder-quobyte-622da146-d969-4459-8786-38923cee181d" released by "delete_volume" :: held 0.642s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] Created reservations ['5e6bf519-444c-4ff0-8e8b-99cd7fb121fe'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:07 devstack cinder-volume[87269]: WARNING cinder.quota [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1043691968 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1043691968, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:44:07 devstack cinder-volume[87269]: WARNING cinder.quota [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1043691968 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1043691968, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] Created reservations ['91477947-ab7f-4681-a760-bf0041b4ccd8', 'ec202350-7417-48f1-aeb3-ffbfb73645da', '0c2e2259-5230-42dd-8e6b-c12826364ddc', 'f0003989-4b24-4423-96cc-b8f034d61853'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:07 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:44:07 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:07 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.249s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:44:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ce33a94e-eb81-4a44-a30e-2d9d2348a18a tempest-GroupsTest-428546884 None] Delete group completed successfully. Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-3b9a4bdb-b519-44f2-a735-1815c0504a83 tempest-GroupsTest-428546884 None] Created reservations ['4e20b656-d051-420b-a855-ebef00415214'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3b9a4bdb-b519-44f2-a735-1815c0504a83 tempest-GroupsTest-428546884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3b9a4bdb-b519-44f2-a735-1815c0504a83 tempest-GroupsTest-428546884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3b9a4bdb-b519-44f2-a735-1815c0504a83 tempest-GroupsTest-428546884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3b9a4bdb-b519-44f2-a735-1815c0504a83 tempest-GroupsTest-428546884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3b9a4bdb-b519-44f2-a735-1815c0504a83 tempest-GroupsTest-428546884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3b9a4bdb-b519-44f2-a735-1815c0504a83 tempest-GroupsTest-428546884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:07 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:44:07 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:08 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3b9a4bdb-b519-44f2-a735-1815c0504a83 tempest-GroupsTest-428546884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.251s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:08 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-3b9a4bdb-b519-44f2-a735-1815c0504a83 tempest-GroupsTest-428546884 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:44:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3b9a4bdb-b519-44f2-a735-1815c0504a83 tempest-GroupsTest-428546884 None] Delete group completed successfully. Jul 13 20:44:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-49935782-a0ff-4e3e-8a0c-db37840f6444 tempest-GroupsTest-428546884 None] Group tempest-GroupsTest-Group-618957975: creating Jul 13 20:44:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-49935782-a0ff-4e3e-8a0c-db37840f6444 tempest-GroupsTest-428546884 None] Group tempest-GroupsTest-Group-618957975: created successfully Jul 13 20:44:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-49935782-a0ff-4e3e-8a0c-db37840f6444 tempest-GroupsTest-428546884 None] Create group completed successfully. Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=73,cinder:UPDATE=92,cinder:INSERT=18,cinder:DELETE=5 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Flow 'volume_create_manager' (c1dd8637-9628-46f4-83b3-bc22c390e84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff7dcb1-3bf6-4911-b026-2cbad82774d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff7dcb1-3bf6-4911-b026-2cbad82774d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1755591484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=847777b1-e6b5-415c-9396-6a4348b24bdd,host='devstack@QuobyteHD#QuobyteHD',id=49517c52-5ae6-4c39-8e93-8385bcd6d9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a022044b584a599e5567ab5e8eff17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:11Z,use_quota=True,user_id='39969d8966c644f08f2ac761ad942206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec015425-03ed-4d56-8e42-2862c96693f6),volume_type_id=ec015425-03ed-4d56-8e42-2862c96693f6)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632ded81-4f11-42a3-aa0b-34c5920e60ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632ded81-4f11-42a3-aa0b-34c5920e60ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ab7c3c-4946-4e6b-ae12-727ae60e7614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ab7c3c-4946-4e6b-ae12-727ae60e7614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49517c52-5ae6-4c39-8e93-8385bcd6d9a3', 'volume_name': 'volume-49517c52-5ae6-4c39-8e93-8385bcd6d9a3', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb2a0af-2bd2-40bd-aabc-b2e658005612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb2a0af-2bd2-40bd-aabc-b2e658005612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15669d2b-2128-4beb-9f68-5399044303bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:11 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Volume 49517c52-5ae6-4c39-8e93-8385bcd6d9a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49517c52-5ae6-4c39-8e93-8385bcd6d9a3', 'volume_size': 1} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=847777b1-e6b5-415c-9396-6a4348b24bdd,created_at=2026-07-13T18:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1755591484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=847777b1-e6b5-415c-9396-6a4348b24bdd,host='devstack@QuobyteHD#QuobyteHD',id=49517c52-5ae6-4c39-8e93-8385bcd6d9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a022044b584a599e5567ab5e8eff17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:11Z,use_quota=True,user_id='39969d8966c644f08f2ac761ad942206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec015425-03ed-4d56-8e42-2862c96693f6),volume_type_id=ec015425-03ed-4d56-8e42-2862c96693f6)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Creating volume 49517c52-5ae6-4c39-8e93-8385bcd6d9a3 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:44:11 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49517c52-5ae6-4c39-8e93-8385bcd6d9a3 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:11 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49517c52-5ae6-4c39-8e93-8385bcd6d9a3 1073741824 Jul 13 20:44:11 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:11 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49517c52-5ae6-4c39-8e93-8385bcd6d9a3 1073741824" returned: 0 in 0.401s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49517c52-5ae6-4c39-8e93-8385bcd6d9a3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:11 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49517c52-5ae6-4c39-8e93-8385bcd6d9a3 Jul 13 20:44:11 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:11 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49517c52-5ae6-4c39-8e93-8385bcd6d9a3" returned: 0 in 0.246s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15669d2b-2128-4beb-9f68-5399044303bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49517c52-5ae6-4c39-8e93-8385bcd6d9a3', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1ecd66-b860-413b-8d06-62db0d60e5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:11 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Volume volume-49517c52-5ae6-4c39-8e93-8385bcd6d9a3 (49517c52-5ae6-4c39-8e93-8385bcd6d9a3): created successfully Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1ecd66-b860-413b-8d06-62db0d60e5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Flow 'volume_create_manager' (c1dd8637-9628-46f4-83b3-bc22c390e84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-31091ac7-34e5-4683-ad98-44c908d13d4e tempest-GroupsTest-428546884 None] Created volume successfully. Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Flow 'volume_create_manager' (27f1b6d8-de68-45f0-b482-e385f2eb9a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d26179e-df81-46f4-a65d-e62a54ec305f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d26179e-df81-46f4-a65d-e62a54ec305f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-911553559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=847777b1-e6b5-415c-9396-6a4348b24bdd,host='devstack@QuobyteHD#QuobyteHD',id=52681a71-fe6a-4ca9-9c60-69ca7916adc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a022044b584a599e5567ab5e8eff17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:13Z,use_quota=True,user_id='39969d8966c644f08f2ac761ad942206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec015425-03ed-4d56-8e42-2862c96693f6),volume_type_id=ec015425-03ed-4d56-8e42-2862c96693f6)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc7d8fc-7bff-4176-88ff-d7f598c08c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc7d8fc-7bff-4176-88ff-d7f598c08c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482dfe4b-16c3-4067-bf3a-d4faf3fa6568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482dfe4b-16c3-4067-bf3a-d4faf3fa6568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52681a71-fe6a-4ca9-9c60-69ca7916adc1', 'volume_name': 'volume-52681a71-fe6a-4ca9-9c60-69ca7916adc1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a41ee3a-4a05-46c7-8bb1-de4715e174e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a41ee3a-4a05-46c7-8bb1-de4715e174e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13545be-1c47-4c3b-ba9f-50c8de698d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:12 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Volume 52681a71-fe6a-4ca9-9c60-69ca7916adc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52681a71-fe6a-4ca9-9c60-69ca7916adc1', 'volume_size': 1} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=847777b1-e6b5-415c-9396-6a4348b24bdd,created_at=2026-07-13T18:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-911553559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=847777b1-e6b5-415c-9396-6a4348b24bdd,host='devstack@QuobyteHD#QuobyteHD',id=52681a71-fe6a-4ca9-9c60-69ca7916adc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a022044b584a599e5567ab5e8eff17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:13Z,use_quota=True,user_id='39969d8966c644f08f2ac761ad942206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec015425-03ed-4d56-8e42-2862c96693f6),volume_type_id=ec015425-03ed-4d56-8e42-2862c96693f6)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Creating volume 52681a71-fe6a-4ca9-9c60-69ca7916adc1 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:44:12 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:44:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52681a71-fe6a-4ca9-9c60-69ca7916adc1 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:12 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52681a71-fe6a-4ca9-9c60-69ca7916adc1 1073741824 Jul 13 20:44:12 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:13 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52681a71-fe6a-4ca9-9c60-69ca7916adc1 1073741824" returned: 0 in 0.410s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52681a71-fe6a-4ca9-9c60-69ca7916adc1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:13 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52681a71-fe6a-4ca9-9c60-69ca7916adc1 Jul 13 20:44:13 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:13 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52681a71-fe6a-4ca9-9c60-69ca7916adc1" returned: 0 in 0.257s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:44:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13545be-1c47-4c3b-ba9f-50c8de698d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52681a71-fe6a-4ca9-9c60-69ca7916adc1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310ece11-f979-4718-9432-2a340b991604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:13 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Volume volume-52681a71-fe6a-4ca9-9c60-69ca7916adc1 (52681a71-fe6a-4ca9-9c60-69ca7916adc1): created successfully Jul 13 20:44:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310ece11-f979-4718-9432-2a340b991604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Flow 'volume_create_manager' (27f1b6d8-de68-45f0-b482-e385f2eb9a75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:13 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c760a7c7-61f0-4cb9-a107-8160d9cd2369 tempest-GroupsTest-428546884 None] Created volume successfully. Jul 13 20:44:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6c8395b8-f63b-4b1d-83c6-15701600bd71 tempest-GroupsTest-428546884 None] Update group completed successfully. Jul 13 20:44:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-1c388029-ca62-4233-aacd-cef007e9460f req-86b35998-fcbc-49b2-b1db-a925f963bf59 tempest-TestStampPattern-124054419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-1c388029-ca62-4233-aacd-cef007e9460f req-86b35998-fcbc-49b2-b1db-a925f963bf59 tempest-TestStampPattern-124054419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:15 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a86eef-0b5e-42da-95b3-8e655db2fec9]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-1c388029-ca62-4233-aacd-cef007e9460f req-86b35998-fcbc-49b2-b1db-a925f963bf59 tempest-TestStampPattern-124054419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3eff609c-51a1-4a4c-8f25-88488276dc48 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:15 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3eff609c-51a1-4a4c-8f25-88488276dc48 Jul 13 20:44:15 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e90a072d-1623-4c1d-8ad2-c4b88d7b4c64 tempest-GroupsTest-428546884 None] Update group completed successfully. Jul 13 20:44:15 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-1c388029-ca62-4233-aacd-cef007e9460f req-86b35998-fcbc-49b2-b1db-a925f963bf59 tempest-TestStampPattern-124054419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3eff609c-51a1-4a4c-8f25-88488276dc48" returned: 0 in 0.366s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-1c388029-ca62-4233-aacd-cef007e9460f req-86b35998-fcbc-49b2-b1db-a925f963bf59 tempest-TestStampPattern-124054419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.388s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-1c388029-ca62-4233-aacd-cef007e9460f req-86b35998-fcbc-49b2-b1db-a925f963bf59 tempest-TestStampPattern-124054419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-3eff609c-51a1-4a4c-8f25-88488276dc48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46d80fb7-63e7-4318-ac95-70b3aec673f9', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:44:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-1c388029-ca62-4233-aacd-cef007e9460f req-86b35998-fcbc-49b2-b1db-a925f963bf59 tempest-TestStampPattern-124054419 None] attachment_update completed successfully. Jul 13 20:44:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Acquiring lock "cinder-quobyte-49517c52-5ae6-4c39-8e93-8385bcd6d9a3" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Lock "cinder-quobyte-49517c52-5ae6-4c39-8e93-8385bcd6d9a3" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:17 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[877c0088-90a0-4d1a-bee1-786d8fb8a671]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49517c52-5ae6-4c39-8e93-8385bcd6d9a3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:17 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49517c52-5ae6-4c39-8e93-8385bcd6d9a3 Jul 13 20:44:17 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:17 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49517c52-5ae6-4c39-8e93-8385bcd6d9a3" returned: 0 in 0.405s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49517c52-5ae6-4c39-8e93-8385bcd6d9a3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:17 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49517c52-5ae6-4c39-8e93-8385bcd6d9a3 Jul 13 20:44:17 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:17 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-49517c52-5ae6-4c39-8e93-8385bcd6d9a3" returned: 0 in 0.268s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Lock "cinder-quobyte-49517c52-5ae6-4c39-8e93-8385bcd6d9a3" released by "delete_volume" :: held 0.720s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Acquiring lock "cinder-quobyte-52681a71-fe6a-4ca9-9c60-69ca7916adc1" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Lock "cinder-quobyte-52681a71-fe6a-4ca9-9c60-69ca7916adc1" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:17 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6953cec5-8d65-475e-b895-e7639dc81ce3]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52681a71-fe6a-4ca9-9c60-69ca7916adc1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:17 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52681a71-fe6a-4ca9-9c60-69ca7916adc1 Jul 13 20:44:17 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:18 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52681a71-fe6a-4ca9-9c60-69ca7916adc1" returned: 0 in 0.415s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52681a71-fe6a-4ca9-9c60-69ca7916adc1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:18 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52681a71-fe6a-4ca9-9c60-69ca7916adc1 Jul 13 20:44:18 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:18 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52681a71-fe6a-4ca9-9c60-69ca7916adc1" returned: 0 in 0.256s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Lock "cinder-quobyte-52681a71-fe6a-4ca9-9c60-69ca7916adc1" released by "delete_volume" :: held 0.709s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Created reservations ['38f7ae50-a31a-4a22-9af2-172c79d04ace'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:18 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-63782972-fbca-434b-bb7e-3095c6d10df9 req-424b868a-9f86-4383-9964-a5a5401f2cc6 tempest-TestStampPattern-124054419 None] Terminate volume connection completed successfully. Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-63782972-fbca-434b-bb7e-3095c6d10df9 req-424b868a-9f86-4383-9964-a5a5401f2cc6 tempest-TestStampPattern-124054419 None] Deleting attachment 46d80fb7-63e7-4318-ac95-70b3aec673f9. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:44:18 devstack cinder-volume[87269]: WARNING cinder.quota [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-454972223 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-454972223, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:44:18 devstack cinder-volume[87269]: WARNING cinder.quota [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-454972223 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-454972223, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Created reservations ['b331e5cf-0743-4afb-ae01-adf51950121a', 'c78ec187-d3a0-4e46-b51b-6ea90ad5e068', '5c319f26-a399-4ff8-8563-b47969b4d681', '08b4a2fb-6510-432b-975f-65033c708bd7'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Created reservations ['c09e7b2d-3fd9-4dbb-92cc-27f3cd9f852e', '01f32698-3ac3-4356-8413-a14d3240b539', 'ad548ad8-035d-4016-abbb-e075ac41f349', '0758a87b-e4a7-4691-9faa-b92586eac91d'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:18 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:44:18 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:19 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:44:19 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:19 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.278s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:44:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:44:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:44:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:44:19 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.281s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:44:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a99afd5c-ec90-42c3-8345-e3351d7c1b60 tempest-GroupsTest-428546884 None] Delete group completed successfully. Jul 13 20:44:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] Acquiring lock "cinder-3eff609c-51a1-4a4c-8f25-88488276dc48-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] Lock "cinder-3eff609c-51a1-4a4c-8f25-88488276dc48-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] Acquiring lock "cinder-quobyte-3eff609c-51a1-4a4c-8f25-88488276dc48" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] Lock "cinder-quobyte-3eff609c-51a1-4a4c-8f25-88488276dc48" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:23 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bd9cc9-f183-4bd4-958f-7b11dc4d6b15]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3eff609c-51a1-4a4c-8f25-88488276dc48 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:23 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3eff609c-51a1-4a4c-8f25-88488276dc48 Jul 13 20:44:23 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:23 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3eff609c-51a1-4a4c-8f25-88488276dc48" returned: 0 in 0.378s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3eff609c-51a1-4a4c-8f25-88488276dc48 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:23 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3eff609c-51a1-4a4c-8f25-88488276dc48 Jul 13 20:44:23 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:23 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3eff609c-51a1-4a4c-8f25-88488276dc48" returned: 0 in 0.256s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] Lock "cinder-quobyte-3eff609c-51a1-4a4c-8f25-88488276dc48" released by "delete_volume" :: held 0.684s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:23 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] Created reservations ['ed9b5092-559d-4d30-af79-48893d267627', 'cd91d933-59af-4477-92db-bcdadb8ef9c3', '6d40a705-7ff7-462f-8a73-b77864667c9c', '312b382d-03b4-4b9f-bdcb-11ea784f7cfb'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:23 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:44:23 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:24 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.269s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:24 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:44:24 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] Deleted volume successfully. Jul 13 20:44:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d0bed440-82e0-4847-b790-a9c1cd94efc9 tempest-TestStampPattern-124054419 None] Lock "cinder-3eff609c-51a1-4a4c-8f25-88488276dc48-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] Acquiring lock "cinder-9ae0108d-788c-4956-a301-d28a6afa1b74-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] Lock "cinder-9ae0108d-788c-4956-a301-d28a6afa1b74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] Acquiring lock "cinder-quobyte-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] Lock "cinder-quobyte-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] Acquiring lock "cinder-quobyte-9ae0108d-788c-4956-a301-d28a6afa1b74" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] Lock "cinder-quobyte-9ae0108d-788c-4956-a301-d28a6afa1b74" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] Deleting offline snapshot 9ae0108d-788c-4956-a301-d28a6afa1b74 of volume c2087e6f-614f-4ff6-8a65-d4c13e67ba2d {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:44:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] snapshot_file for this snap is: volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:44:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6e2fb6-f13c-4922-a751-e9f36ddedb2f]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:24 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74 Jul 13 20:44:24 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:24 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74" returned: 0 in 0.394s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:44:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8daaa1ee-9443-4518-807c-b2719e993d2b]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:25 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d Jul 13 20:44:25 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:25 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d" returned: 0 in 0.400s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:25 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74 Jul 13 20:44:25 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:25 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74" returned: 0 in 0.389s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:25 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74 Jul 13 20:44:25 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Flow 'volume_create_manager' (2bd86376-4090-4329-a686-693121fece17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5188321c-b18f-45d4-bfc6-a22007992e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5188321c-b18f-45d4-bfc6-a22007992e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1298658987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75b70ff-d385-4d14-ab07-a14eb1de5519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd7042e0abc4617984d98c2163a040d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:26Z,use_quota=True,user_id='e055d1d03beb4a488f86be87a246d049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3869079d-83d9-474e-9a7b-726543be5efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3869079d-83d9-474e-9a7b-726543be5efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a98dc1f-24cf-4e4d-ab91-1fb71abe158d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a98dc1f-24cf-4e4d-ab91-1fb71abe158d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a75b70ff-d385-4d14-ab07-a14eb1de5519', 'volume_name': 'volume-a75b70ff-d385-4d14-ab07-a14eb1de5519', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7612bd-5db4-4e5d-aa79-dbd892750669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7612bd-5db4-4e5d-aa79-dbd892750669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc4a4e4-dfc9-4781-8208-4a506dcd9842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:25 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Volume a75b70ff-d385-4d14-ab07-a14eb1de5519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a75b70ff-d385-4d14-ab07-a14eb1de5519', 'volume_size': 1} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1298658987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75b70ff-d385-4d14-ab07-a14eb1de5519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd7042e0abc4617984d98c2163a040d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:26Z,use_quota=True,user_id='e055d1d03beb4a488f86be87a246d049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Creating volume a75b70ff-d385-4d14-ab07-a14eb1de5519 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:44:25 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:44:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:25 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519 1073741824 Jul 13 20:44:25 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:26 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d.9ae0108d-788c-4956-a301-d28a6afa1b74" returned: 0 in 0.260s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] Lock "cinder-quobyte-9ae0108d-788c-4956-a301-d28a6afa1b74" released by "_delete_snapshot" :: held 1.590s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] Lock "cinder-quobyte-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d" released by "delete_snapshot" :: held 1.620s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:26 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] Created reservations ['49505cd7-9b26-4470-9300-e26f08911964', '045e29fc-e112-4ab7-acb0-01666cab490e', '000f2c1b-3d48-4f26-93e9-38fe54b6e39c', '3985cf4e-1935-487a-87b7-4130b67e9f61'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:26 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] Delete snapshot completed successfully. Jul 13 20:44:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c593000-6af4-4bf5-ad03-4d4f7f1ee63f tempest-TestStampPattern-124054419 None] Lock "cinder-9ae0108d-788c-4956-a301-d28a6afa1b74-delete_snapshot" released by "delete_snapshot" :: held 1.775s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:26 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519 1073741824" returned: 0 in 0.465s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:26 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519 Jul 13 20:44:26 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:26 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519" returned: 0 in 0.252s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:44:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc4a4e4-dfc9-4781-8208-4a506dcd9842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a75b70ff-d385-4d14-ab07-a14eb1de5519', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e452f7aa-6163-423b-b815-60cb6bafa4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:26 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Volume volume-a75b70ff-d385-4d14-ab07-a14eb1de5519 (a75b70ff-d385-4d14-ab07-a14eb1de5519): created successfully Jul 13 20:44:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e452f7aa-6163-423b-b815-60cb6bafa4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Flow 'volume_create_manager' (2bd86376-4090-4329-a686-693121fece17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:26 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-44d506ec-ff31-4a04-8d94-321664104f3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Created volume successfully. Jul 13 20:44:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-31462b0b-a92d-43a7-93fe-ce91f622e7b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-31462b0b-a92d-43a7-93fe-ce91f622e7b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-31462b0b-a92d-43a7-93fe-ce91f622e7b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Creating offline snapshot 9c0e19d6-1e6a-47c7-a05d-2ddd72cafded of volume a75b70ff-d385-4d14-ab07-a14eb1de5519 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:44:28 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2675b3b5-5736-4eb4-b7c3-6d92735db8b1]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31462b0b-a92d-43a7-93fe-ce91f622e7b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:28 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519 Jul 13 20:44:28 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:28 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31462b0b-a92d-43a7-93fe-ce91f622e7b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519" returned: 0 in 0.441s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31462b0b-a92d-43a7-93fe-ce91f622e7b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:28 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded 1G Jul 13 20:44:28 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:29 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31462b0b-a92d-43a7-93fe-ce91f622e7b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded 1G" returned: 0 in 0.487s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31462b0b-a92d-43a7-93fe-ce91f622e7b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a75b70ff-d385-4d14-ab07-a14eb1de5519 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:29 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a75b70ff-d385-4d14-ab07-a14eb1de5519 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded Jul 13 20:44:29 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:29 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31462b0b-a92d-43a7-93fe-ce91f622e7b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a75b70ff-d385-4d14-ab07-a14eb1de5519 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded" returned: 0 in 0.314s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:29 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-31462b0b-a92d-43a7-93fe-ce91f622e7b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded is being set with open permissions: ugo+rw Jul 13 20:44:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31462b0b-a92d-43a7-93fe-ce91f622e7b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:29 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded Jul 13 20:44:29 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:29 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31462b0b-a92d-43a7-93fe-ce91f622e7b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded" returned: 0 in 0.235s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31462b0b-a92d-43a7-93fe-ce91f622e7b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:29 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.info Jul 13 20:44:29 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:30 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31462b0b-a92d-43a7-93fe-ce91f622e7b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.info" returned: 0 in 0.258s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:30 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-31462b0b-a92d-43a7-93fe-ce91f622e7b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.info is being set with open permissions: ugo+rw Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31462b0b-a92d-43a7-93fe-ce91f622e7b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:30 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.info Jul 13 20:44:30 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] Acquiring lock "cinder-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] Lock "cinder-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] Acquiring lock "cinder-quobyte-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] Lock "cinder-quobyte-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d" acquired by "delete_volume" :: waited 0.013s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a18f8e6-ad00-41b2-a9f9-aedfaa652b7a]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:30 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31462b0b-a92d-43a7-93fe-ce91f622e7b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.info" returned: 0 in 0.266s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-31462b0b-a92d-43a7-93fe-ce91f622e7b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:30 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d Jul 13 20:44:30 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-31462b0b-a92d-43a7-93fe-ce91f622e7b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Create snapshot completed successfully Jul 13 20:44:30 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d" returned: 0 in 0.373s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:30 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d Jul 13 20:44:30 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:30 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d" returned: 0 in 0.243s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] Lock "cinder-quobyte-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d" released by "delete_volume" :: held 0.675s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] Created reservations ['841574ab-1a27-4468-beb4-7b00284b62c4', '397e581e-aca2-4980-930e-f93a2030b77c', 'd755bf25-ec0b-4510-b713-fc88f0bf935f', 'ce0e9a45-dcb7-4def-bb88-4d7448393eab'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:30 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:44:31 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:31 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.251s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:31 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:44:31 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] Deleted volume successfully. Jul 13 20:44:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b7a2c1a9-67dd-487b-ac21-7508468372c7 tempest-TestStampPattern-124054419 None] Lock "cinder-c2087e6f-614f-4ff6-8a65-d4c13e67ba2d-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Acquiring lock "cinder-9c0e19d6-1e6a-47c7-a05d-2ddd72cafded-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Lock "cinder-9c0e19d6-1e6a-47c7-a05d-2ddd72cafded-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Acquiring lock "cinder-quobyte-a75b70ff-d385-4d14-ab07-a14eb1de5519" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Lock "cinder-quobyte-a75b70ff-d385-4d14-ab07-a14eb1de5519" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Acquiring lock "cinder-quobyte-9c0e19d6-1e6a-47c7-a05d-2ddd72cafded" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Lock "cinder-quobyte-9c0e19d6-1e6a-47c7-a05d-2ddd72cafded" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Deleting offline snapshot 9c0e19d6-1e6a-47c7-a05d-2ddd72cafded of volume a75b70ff-d385-4d14-ab07-a14eb1de5519 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:44:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] snapshot_file for this snap is: volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:44:31 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed0841f-7c8b-4f96-9f5f-37e198ae578c]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:32 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded Jul 13 20:44:32 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:32 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded" returned: 0 in 0.380s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a75b70ff-d385-4d14-ab07-a14eb1de5519(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:44:32 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3ac4fd-7c5f-488a-9fed-68385faaa68e]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:32 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519 Jul 13 20:44:32 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:32 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519" returned: 0 in 0.394s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:32 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded Jul 13 20:44:32 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:33 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded" returned: 0 in 0.383s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:33 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded Jul 13 20:44:33 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:33 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519.9c0e19d6-1e6a-47c7-a05d-2ddd72cafded" returned: 0 in 0.257s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Lock "cinder-quobyte-9c0e19d6-1e6a-47c7-a05d-2ddd72cafded" released by "_delete_snapshot" :: held 1.542s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Lock "cinder-quobyte-a75b70ff-d385-4d14-ab07-a14eb1de5519" released by "delete_snapshot" :: held 1.563s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:33 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Created reservations ['6c930387-19a6-4685-8485-6b1a0e072301', '5cc3c125-8d0c-4ad2-b328-1418d55864ad', '1befb33d-1f76-4a24-a3c6-b4074fc4da39', 'f40ff61f-214d-41d7-94ce-eb31b52de52e'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:33 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Delete snapshot completed successfully. Jul 13 20:44:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-67606fbc-0b43-42b0-a4ca-80c083276434 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Lock "cinder-9c0e19d6-1e6a-47c7-a05d-2ddd72cafded-delete_snapshot" released by "delete_snapshot" :: held 1.719s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Acquiring lock "cinder-a75b70ff-d385-4d14-ab07-a14eb1de5519-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Lock "cinder-a75b70ff-d385-4d14-ab07-a14eb1de5519-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Acquiring lock "cinder-quobyte-a75b70ff-d385-4d14-ab07-a14eb1de5519" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Lock "cinder-quobyte-a75b70ff-d385-4d14-ab07-a14eb1de5519" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:34 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f749b38-0e86-4b81-a4d4-1b0220ffae9d]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:34 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519 Jul 13 20:44:34 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:34 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519" returned: 0 in 0.393s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:34 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519 Jul 13 20:44:34 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:34 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a75b70ff-d385-4d14-ab07-a14eb1de5519" returned: 0 in 0.256s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Lock "cinder-quobyte-a75b70ff-d385-4d14-ab07-a14eb1de5519" released by "delete_volume" :: held 0.753s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:34 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Created reservations ['bee4f8c2-50ca-4589-9f87-538273120524', 'e2e39dd1-2b48-46ed-8a2b-911ffc925992', 'bcc9a582-3659-4b26-92c9-15f1ce7ebab1', 'df417056-57df-4d22-9065-26eafa5f5c04'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:35 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:44:35 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:35 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.263s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:35 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:44:35 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Deleted volume successfully. Jul 13 20:44:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-487b2393-e7f7-49e4-9202-e81ed90d9107 tempest-VolumeSnapshotQuotasNegativeTestJSON-1647863746 None] Lock "cinder-a75b70ff-d385-4d14-ab07-a14eb1de5519-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Flow 'volume_create_manager' (cfc3f91e-daa4-4e5c-8af9-2a7c06192ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5974e5ac-fad4-4f30-a1b6-2db016f4338d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5974e5ac-fad4-4f30-a1b6-2db016f4338d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-226924930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cedf37-032a-4a2c-a0f1-a3ea64e69891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b15a0308ff7434495a8e719d22e6d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:42Z,use_quota=True,user_id='f02aa57154bd4277a191f2c422fe7994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df033957-0241-44ce-a1fd-fe514301eaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df033957-0241-44ce-a1fd-fe514301eaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c73b4a-d905-4f40-a4af-4657c17c6d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c73b4a-d905-4f40-a4af-4657c17c6d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53cedf37-032a-4a2c-a0f1-a3ea64e69891', 'volume_name': 'volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db5e5fb-65c9-4bc9-9c99-e51722207e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db5e5fb-65c9-4bc9-9c99-e51722207e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca64e82-3009-4def-a683-744f23569382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:42 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Volume 53cedf37-032a-4a2c-a0f1-a3ea64e69891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891', 'volume_size': 1} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-226924930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cedf37-032a-4a2c-a0f1-a3ea64e69891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b15a0308ff7434495a8e719d22e6d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:42Z,use_quota=True,user_id='f02aa57154bd4277a191f2c422fe7994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Creating volume 53cedf37-032a-4a2c-a0f1-a3ea64e69891 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:44:42 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:42 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891 1073741824 Jul 13 20:44:42 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:42 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891 1073741824" returned: 0 in 0.466s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:42 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891 Jul 13 20:44:42 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:42 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891" returned: 0 in 0.257s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca64e82-3009-4def-a683-744f23569382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef88d29-9cde-4fa7-85b5-72feb01e512b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:42 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Volume volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891 (53cedf37-032a-4a2c-a0f1-a3ea64e69891): created successfully Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef88d29-9cde-4fa7-85b5-72feb01e512b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Flow 'volume_create_manager' (cfc3f91e-daa4-4e5c-8af9-2a7c06192ae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:42 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4ee33eea-a9af-42fe-8d59-ded226eebad7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Created volume successfully. Jul 13 20:44:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-23aed45c-5171-4141-9a7b-02c9ee39b311 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-23aed45c-5171-4141-9a7b-02c9ee39b311 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-23aed45c-5171-4141-9a7b-02c9ee39b311 tempest-CreateVolumesFromSnapshotTest-52661885 None] Creating offline snapshot 69af0924-96d4-4f63-bedb-48966e1a772d of volume 53cedf37-032a-4a2c-a0f1-a3ea64e69891 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:44:43 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2580f8-de7a-49d2-b761-d8c0355eff9e]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-23aed45c-5171-4141-9a7b-02c9ee39b311 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:43 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891 Jul 13 20:44:43 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:43 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-23aed45c-5171-4141-9a7b-02c9ee39b311 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891" returned: 0 in 0.371s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-23aed45c-5171-4141-9a7b-02c9ee39b311 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:43 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d 1G Jul 13 20:44:43 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:44 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-23aed45c-5171-4141-9a7b-02c9ee39b311 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d 1G" returned: 0 in 0.429s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-23aed45c-5171-4141-9a7b-02c9ee39b311 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:44 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d Jul 13 20:44:44 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:44 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-23aed45c-5171-4141-9a7b-02c9ee39b311 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d" returned: 0 in 0.297s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:44 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-23aed45c-5171-4141-9a7b-02c9ee39b311 tempest-CreateVolumesFromSnapshotTest-52661885 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d is being set with open permissions: ugo+rw Jul 13 20:44:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-23aed45c-5171-4141-9a7b-02c9ee39b311 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:44 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d Jul 13 20:44:44 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:44 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-23aed45c-5171-4141-9a7b-02c9ee39b311 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d" returned: 0 in 0.254s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-23aed45c-5171-4141-9a7b-02c9ee39b311 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:44 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.info Jul 13 20:44:44 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:44 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-23aed45c-5171-4141-9a7b-02c9ee39b311 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.info" returned: 0 in 0.261s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:44 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-23aed45c-5171-4141-9a7b-02c9ee39b311 tempest-CreateVolumesFromSnapshotTest-52661885 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.info is being set with open permissions: ugo+rw Jul 13 20:44:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-23aed45c-5171-4141-9a7b-02c9ee39b311 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:45 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.info Jul 13 20:44:45 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:45 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-23aed45c-5171-4141-9a7b-02c9ee39b311 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.info" returned: 0 in 0.253s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-23aed45c-5171-4141-9a7b-02c9ee39b311 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:45 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-23aed45c-5171-4141-9a7b-02c9ee39b311 tempest-CreateVolumesFromSnapshotTest-52661885 None] Create snapshot completed successfully Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Flow 'volume_create_manager' (d77168d9-eecd-4afe-977a-30fee54c2580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325cdfd1-ddf9-462d-aa69-d706b453a8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325cdfd1-ddf9-462d-aa69-d706b453a8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1176036459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9292192e-6dad-4d16-8caa-a72df06dca97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd29361e04b4072ba3e7dafcad48426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:46Z,use_quota=True,user_id='a8c88e5d2efd4fc5a25a9819c7e29f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd65a11-f65a-4488-9c0b-473f460a9e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd65a11-f65a-4488-9c0b-473f460a9e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047d3494-4aa3-4448-abe9-3e2fea9ae748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047d3494-4aa3-4448-abe9-3e2fea9ae748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9292192e-6dad-4d16-8caa-a72df06dca97', 'volume_name': 'volume-9292192e-6dad-4d16-8caa-a72df06dca97', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc62b18-ad53-49ae-80dd-9b9937d5373c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc62b18-ad53-49ae-80dd-9b9937d5373c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8cbe9c-7fd0-49cf-b6d1-3b0bd7fa910f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:45 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Volume 9292192e-6dad-4d16-8caa-a72df06dca97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9292192e-6dad-4d16-8caa-a72df06dca97', 'volume_size': 1} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1176036459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9292192e-6dad-4d16-8caa-a72df06dca97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd29361e04b4072ba3e7dafcad48426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:46Z,use_quota=True,user_id='a8c88e5d2efd4fc5a25a9819c7e29f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Creating volume 9292192e-6dad-4d16-8caa-a72df06dca97 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:44:45 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9292192e-6dad-4d16-8caa-a72df06dca97 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:45 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9292192e-6dad-4d16-8caa-a72df06dca97 1073741824 Jul 13 20:44:45 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Flow 'volume_create_manager' (2911ad0e-49f5-4645-a0cf-298a97589d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56960b23-2a39-4e2e-8707-88a8b6700fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56960b23-2a39-4e2e-8707-88a8b6700fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1081603535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ade3fd2-4f21-4b2b-b802-69facdd87116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b15a0308ff7434495a8e719d22e6d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:46Z,use_quota=True,user_id='f02aa57154bd4277a191f2c422fe7994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a3d389-f1c8-443a-8899-1bdc91957da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a3d389-f1c8-443a-8899-1bdc91957da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f22089-127a-4bbc-956f-60cc9a486c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f22089-127a-4bbc-956f-60cc9a486c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ade3fd2-4f21-4b2b-b802-69facdd87116', 'volume_name': 'volume-7ade3fd2-4f21-4b2b-b802-69facdd87116', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617bf2b4-14f6-4f88-83df-a1ef047d87e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617bf2b4-14f6-4f88-83df-a1ef047d87e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962f7ae6-508b-4f5b-b0d1-9afd6b5f415d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:46 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Volume 7ade3fd2-4f21-4b2b-b802-69facdd87116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ade3fd2-4f21-4b2b-b802-69facdd87116', 'volume_size': 1} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Flow 'volume_create_manager' (49fff982-a63c-4b00-afa2-c2704592ed19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d25cbb-374b-423c-a7d8-58f0f5f65af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d25cbb-374b-423c-a7d8-58f0f5f65af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2102540635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=220145c9-17da-479f-ba5c-207de71899c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b15a0308ff7434495a8e719d22e6d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:46Z,use_quota=True,user_id='f02aa57154bd4277a191f2c422fe7994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:46 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c78319-9ee5-4091-bda6-d4c9e1b53c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c78319-9ee5-4091-bda6-d4c9e1b53c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee13bcd2-421d-44f8-b2db-00f49e45ddd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee13bcd2-421d-44f8-b2db-00f49e45ddd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '220145c9-17da-479f-ba5c-207de71899c4', 'volume_name': 'volume-220145c9-17da-479f-ba5c-207de71899c4', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf9a50f-dcf4-44bd-9fed-b2ef4455be86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf9a50f-dcf4-44bd-9fed-b2ef4455be86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031f3135-f47d-4c85-9340-801d2345c1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:46 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Volume 220145c9-17da-479f-ba5c-207de71899c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-220145c9-17da-479f-ba5c-207de71899c4', 'volume_size': 1} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9292192e-6dad-4d16-8caa-a72df06dca97 1073741824" returned: 0 in 0.587s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9292192e-6dad-4d16-8caa-a72df06dca97 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:46 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9292192e-6dad-4d16-8caa-a72df06dca97 Jul 13 20:44:46 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Flow 'volume_create_manager' (7f9a8cc4-7ef6-434b-b77b-f5e011c58bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c924799-2bdc-4f9e-b2bd-4ba0c5311e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c924799-2bdc-4f9e-b2bd-4ba0c5311e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1264550451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e98d69-0458-4396-af65-c34e31fcf00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b15a0308ff7434495a8e719d22e6d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:47Z,use_quota=True,user_id='f02aa57154bd4277a191f2c422fe7994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40979aa-c026-4a14-a83a-4555d6ecaa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40979aa-c026-4a14-a83a-4555d6ecaa26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e08392-dfa8-486a-a099-5f8807de9057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e08392-dfa8-486a-a099-5f8807de9057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7e98d69-0458-4396-af65-c34e31fcf00f', 'volume_name': 'volume-a7e98d69-0458-4396-af65-c34e31fcf00f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238a4430-e330-45bc-aeff-25395ebdf26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238a4430-e330-45bc-aeff-25395ebdf26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96ed08a-2dab-494c-97eb-d67fa0c562bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:46 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Volume a7e98d69-0458-4396-af65-c34e31fcf00f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7e98d69-0458-4396-af65-c34e31fcf00f', 'volume_size': 1} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:46 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9292192e-6dad-4d16-8caa-a72df06dca97" returned: 0 in 0.325s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.749s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1081603535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ade3fd2-4f21-4b2b-b802-69facdd87116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b15a0308ff7434495a8e719d22e6d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:46Z,use_quota=True,user_id='f02aa57154bd4277a191f2c422fe7994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Creating volume 7ade3fd2-4f21-4b2b-b802-69facdd87116 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:44:46 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7ade3fd2-4f21-4b2b-b802-69facdd87116 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8cbe9c-7fd0-49cf-b6d1-3b0bd7fa910f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9292192e-6dad-4d16-8caa-a72df06dca97', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d04a10-30fb-452d-afa0-e6a8b1fb71af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:46 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7ade3fd2-4f21-4b2b-b802-69facdd87116 1073741824 Jul 13 20:44:46 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:46 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Volume volume-9292192e-6dad-4d16-8caa-a72df06dca97 (9292192e-6dad-4d16-8caa-a72df06dca97): created successfully Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d04a10-30fb-452d-afa0-e6a8b1fb71af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Flow 'volume_create_manager' (d77168d9-eecd-4afe-977a-30fee54c2580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:46 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-cc770535-5db3-4168-9206-b1c367db7616 tempest-VolumesListAdminTestJSON-1585528644 None] Created volume successfully. Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:44:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Flow 'volume_create_manager' (34e6c38f-fda2-4cab-affb-a7cdcadaabcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f12c958-2298-4490-96b1-5acd516c0020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f12c958-2298-4490-96b1-5acd516c0020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-259030863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c63b2ca-ae29-4486-a3ac-9f98d7245012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b15a0308ff7434495a8e719d22e6d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:47Z,use_quota=True,user_id='f02aa57154bd4277a191f2c422fe7994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6daf3f2-e7d2-4cfd-b99a-bca393e37668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6daf3f2-e7d2-4cfd-b99a-bca393e37668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96272331-8cbd-451c-be44-857bbf801d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96272331-8cbd-451c-be44-857bbf801d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c63b2ca-ae29-4486-a3ac-9f98d7245012', 'volume_name': 'volume-0c63b2ca-ae29-4486-a3ac-9f98d7245012', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9378e9-e32b-4664-af6d-fdf78a64cc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9378e9-e32b-4664-af6d-fdf78a64cc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a40e6af-1b9f-4832-9f4e-60d4e6f63139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:47 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Volume 0c63b2ca-ae29-4486-a3ac-9f98d7245012: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c63b2ca-ae29-4486-a3ac-9f98d7245012', 'volume_size': 1} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:47 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7ade3fd2-4f21-4b2b-b802-69facdd87116 1073741824" returned: 0 in 0.533s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Flow 'volume_create_manager' (914714dc-4e52-4293-9f08-30f7f34aa9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f92941c-3b83-42ab-b56b-9bc1faabfb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7ade3fd2-4f21-4b2b-b802-69facdd87116 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f92941c-3b83-42ab-b56b-9bc1faabfb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-15359186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=439e3000-8c11-4ebf-903b-609b157a55b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b15a0308ff7434495a8e719d22e6d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:47Z,use_quota=True,user_id='f02aa57154bd4277a191f2c422fe7994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779e1784-7f0a-4361-a61e-d6363a0a4e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:47 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7ade3fd2-4f21-4b2b-b802-69facdd87116 Jul 13 20:44:47 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779e1784-7f0a-4361-a61e-d6363a0a4e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9479c016-dd32-45e3-9888-4516f273e74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9479c016-dd32-45e3-9888-4516f273e74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '439e3000-8c11-4ebf-903b-609b157a55b6', 'volume_name': 'volume-439e3000-8c11-4ebf-903b-609b157a55b6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9a94cf-b506-493b-8356-88efeee4236e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9a94cf-b506-493b-8356-88efeee4236e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b7ceb4-323a-4605-9331-460b9124cde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:47 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Volume 439e3000-8c11-4ebf-903b-609b157a55b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-439e3000-8c11-4ebf-903b-609b157a55b6', 'volume_size': 1} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:47 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7ade3fd2-4f21-4b2b-b802-69facdd87116" returned: 0 in 0.249s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.229s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2102540635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=220145c9-17da-479f-ba5c-207de71899c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b15a0308ff7434495a8e719d22e6d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:46Z,use_quota=True,user_id='f02aa57154bd4277a191f2c422fe7994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Creating volume 220145c9-17da-479f-ba5c-207de71899c4 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:44:47 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-220145c9-17da-479f-ba5c-207de71899c4 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962f7ae6-508b-4f5b-b0d1-9afd6b5f415d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ade3fd2-4f21-4b2b-b802-69facdd87116', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:47 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-220145c9-17da-479f-ba5c-207de71899c4 1073741824 Jul 13 20:44:47 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb82e9e-bce1-4592-af4e-6158c3d158a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:47 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Volume volume-7ade3fd2-4f21-4b2b-b802-69facdd87116 (7ade3fd2-4f21-4b2b-b802-69facdd87116): created successfully Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb82e9e-bce1-4592-af4e-6158c3d158a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Flow 'volume_create_manager' (2911ad0e-49f5-4645-a0cf-298a97589d39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-81421c0c-f7be-4953-93a3-4d7a1e96d172 tempest-CreateVolumesFromSnapshotTest-52661885 None] Created volume successfully. Jul 13 20:44:48 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-220145c9-17da-479f-ba5c-207de71899c4 1073741824" returned: 0 in 0.462s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-220145c9-17da-479f-ba5c-207de71899c4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:48 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-220145c9-17da-479f-ba5c-207de71899c4 Jul 13 20:44:48 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Flow 'volume_create_manager' (f787c0d4-4613-48d9-a1d7-41d7542741aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77883b4-3992-4027-aea2-4a746bc470c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77883b4-3992-4027-aea2-4a746bc470c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1101810416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd29361e04b4072ba3e7dafcad48426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:48Z,use_quota=True,user_id='a8c88e5d2efd4fc5a25a9819c7e29f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46d93d4-afc1-498f-8ff6-31f90277b462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46d93d4-afc1-498f-8ff6-31f90277b462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835d550d-a543-4709-8f57-e76b0b7c2dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835d550d-a543-4709-8f57-e76b0b7c2dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832', 'volume_name': 'volume-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc12692-91e2-4325-b258-8bd43f1522be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc12692-91e2-4325-b258-8bd43f1522be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5e4ada-f206-4494-bc7d-4b12288367a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:48 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Volume c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832', 'volume_size': 1} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:48 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-220145c9-17da-479f-ba5c-207de71899c4" returned: 0 in 0.268s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.761s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1264550451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e98d69-0458-4396-af65-c34e31fcf00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b15a0308ff7434495a8e719d22e6d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:47Z,use_quota=True,user_id='f02aa57154bd4277a191f2c422fe7994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Creating volume a7e98d69-0458-4396-af65-c34e31fcf00f {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:44:48 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a7e98d69-0458-4396-af65-c34e31fcf00f 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031f3135-f47d-4c85-9340-801d2345c1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-220145c9-17da-479f-ba5c-207de71899c4', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:48 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a7e98d69-0458-4396-af65-c34e31fcf00f 1073741824 Jul 13 20:44:48 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b603bdcb-86e7-4e14-ba3f-0621688b5bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:48 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Volume volume-220145c9-17da-479f-ba5c-207de71899c4 (220145c9-17da-479f-ba5c-207de71899c4): created successfully Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b603bdcb-86e7-4e14-ba3f-0621688b5bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Flow 'volume_create_manager' (49fff982-a63c-4b00-afa2-c2704592ed19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:48 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0fbe610c-dda6-47fa-b54b-0ec4b6bf2f29 tempest-CreateVolumesFromSnapshotTest-52661885 None] Created volume successfully. Jul 13 20:44:48 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a7e98d69-0458-4396-af65-c34e31fcf00f 1073741824" returned: 0 in 0.424s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a7e98d69-0458-4396-af65-c34e31fcf00f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:48 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a7e98d69-0458-4396-af65-c34e31fcf00f Jul 13 20:44:48 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:49 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a7e98d69-0458-4396-af65-c34e31fcf00f" returned: 0 in 0.259s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.137s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-259030863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c63b2ca-ae29-4486-a3ac-9f98d7245012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b15a0308ff7434495a8e719d22e6d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:47Z,use_quota=True,user_id='f02aa57154bd4277a191f2c422fe7994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Creating volume 0c63b2ca-ae29-4486-a3ac-9f98d7245012 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:44:49 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c63b2ca-ae29-4486-a3ac-9f98d7245012 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96ed08a-2dab-494c-97eb-d67fa0c562bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7e98d69-0458-4396-af65-c34e31fcf00f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:49 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c63b2ca-ae29-4486-a3ac-9f98d7245012 1073741824 Jul 13 20:44:49 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe66a21-495c-4d8d-98a1-4c6ec89675e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:49 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Volume volume-a7e98d69-0458-4396-af65-c34e31fcf00f (a7e98d69-0458-4396-af65-c34e31fcf00f): created successfully Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe66a21-495c-4d8d-98a1-4c6ec89675e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Flow 'volume_create_manager' (7f9a8cc4-7ef6-434b-b77b-f5e011c58bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:49 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-24951aec-b2a8-4431-9579-ed17528b2059 tempest-CreateVolumesFromSnapshotTest-52661885 None] Created volume successfully. Jul 13 20:44:49 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c63b2ca-ae29-4486-a3ac-9f98d7245012 1073741824" returned: 0 in 0.457s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c63b2ca-ae29-4486-a3ac-9f98d7245012 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:49 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c63b2ca-ae29-4486-a3ac-9f98d7245012 Jul 13 20:44:49 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:49 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c63b2ca-ae29-4486-a3ac-9f98d7245012" returned: 0 in 0.243s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.452s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-15359186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=439e3000-8c11-4ebf-903b-609b157a55b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b15a0308ff7434495a8e719d22e6d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:47Z,use_quota=True,user_id='f02aa57154bd4277a191f2c422fe7994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Creating volume 439e3000-8c11-4ebf-903b-609b157a55b6 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:44:49 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-439e3000-8c11-4ebf-903b-609b157a55b6 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a40e6af-1b9f-4832-9f4e-60d4e6f63139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c63b2ca-ae29-4486-a3ac-9f98d7245012', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e966e0bf-27ab-4567-9456-1a7ac4ad7909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:49 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-439e3000-8c11-4ebf-903b-609b157a55b6 1073741824 Jul 13 20:44:49 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:49 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Volume volume-0c63b2ca-ae29-4486-a3ac-9f98d7245012 (0c63b2ca-ae29-4486-a3ac-9f98d7245012): created successfully Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e966e0bf-27ab-4567-9456-1a7ac4ad7909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Flow 'volume_create_manager' (34e6c38f-fda2-4cab-affb-a7cdcadaabcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:50 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-92dcb0b8-9f5c-4eb4-9627-cfc1de2f7ea7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Created volume successfully. Jul 13 20:44:50 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-439e3000-8c11-4ebf-903b-609b157a55b6 1073741824" returned: 0 in 0.397s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-439e3000-8c11-4ebf-903b-609b157a55b6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:50 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-439e3000-8c11-4ebf-903b-609b157a55b6 Jul 13 20:44:50 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:50 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-439e3000-8c11-4ebf-903b-609b157a55b6" returned: 0 in 0.248s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.212s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1101810416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd29361e04b4072ba3e7dafcad48426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:48Z,use_quota=True,user_id='a8c88e5d2efd4fc5a25a9819c7e29f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Creating volume c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:44:50 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:50 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832 1073741824 Jul 13 20:44:50 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b7ceb4-323a-4605-9331-460b9124cde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-439e3000-8c11-4ebf-903b-609b157a55b6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b120394f-164e-4572-b2fd-ac0bba6bb650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:50 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Volume volume-439e3000-8c11-4ebf-903b-609b157a55b6 (439e3000-8c11-4ebf-903b-609b157a55b6): created successfully Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b120394f-164e-4572-b2fd-ac0bba6bb650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Flow 'volume_create_manager' (914714dc-4e52-4293-9f08-30f7f34aa9a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:50 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b2c1598e-0f36-4c7a-9c10-5b15c3d2bc8c tempest-CreateVolumesFromSnapshotTest-52661885 None] Created volume successfully. Jul 13 20:44:51 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832 1073741824" returned: 0 in 0.407s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:51 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832 Jul 13 20:44:51 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:51 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832" returned: 0 in 0.232s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:44:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5e4ada-f206-4494-bc7d-4b12288367a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57db23b-fac8-4db9-9184-22cac9239281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:51 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Volume volume-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832 (c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832): created successfully Jul 13 20:44:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57db23b-fac8-4db9-9184-22cac9239281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Flow 'volume_create_manager' (f787c0d4-4613-48d9-a1d7-41d7542741aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:51 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-fc1145bd-7056-46d5-b501-6d68784ef80e tempest-VolumesListAdminTestJSON-1585528644 None] Created volume successfully. Jul 13 20:44:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "cinder-439e3000-8c11-4ebf-903b-609b157a55b6-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-439e3000-8c11-4ebf-903b-609b157a55b6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "cinder-quobyte-439e3000-8c11-4ebf-903b-609b157a55b6" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-quobyte-439e3000-8c11-4ebf-903b-609b157a55b6" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:51 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e1b9da-0e26-4d4e-8ef8-aa500477a380]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-439e3000-8c11-4ebf-903b-609b157a55b6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:51 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:44:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Flow 'volume_create_manager' (4d73632c-3f27-4771-aa7f-4733a01ebd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09642f9e-3791-4656-8d77-ea798c005537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09642f9e-3791-4656-8d77-ea798c005537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-308058733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c53333-a290-4a87-b23f-2a9865211d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd29361e04b4072ba3e7dafcad48426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:52Z,use_quota=True,user_id='a8c88e5d2efd4fc5a25a9819c7e29f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438fc2b4-e901-4fd7-a6b6-94bd84472060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438fc2b4-e901-4fd7-a6b6-94bd84472060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cf85af-5b88-4340-9887-f48c8cdf1465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:52 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-439e3000-8c11-4ebf-903b-609b157a55b6 Jul 13 20:44:52 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cf85af-5b88-4340-9887-f48c8cdf1465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1c53333-a290-4a87-b23f-2a9865211d1c', 'volume_name': 'volume-f1c53333-a290-4a87-b23f-2a9865211d1c', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6263c847-6959-4318-b4c5-ae785ddab8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6263c847-6959-4318-b4c5-ae785ddab8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4c2185-16ed-4bf2-b81a-2735aa014678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:52 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Volume f1c53333-a290-4a87-b23f-2a9865211d1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1c53333-a290-4a87-b23f-2a9865211d1c', 'volume_size': 1} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-308058733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c53333-a290-4a87-b23f-2a9865211d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd29361e04b4072ba3e7dafcad48426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:52Z,use_quota=True,user_id='a8c88e5d2efd4fc5a25a9819c7e29f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Creating volume f1c53333-a290-4a87-b23f-2a9865211d1c {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:44:52 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c53333-a290-4a87-b23f-2a9865211d1c 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:52 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c53333-a290-4a87-b23f-2a9865211d1c 1073741824 Jul 13 20:44:52 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:52 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-439e3000-8c11-4ebf-903b-609b157a55b6" returned: 0 in 0.358s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-439e3000-8c11-4ebf-903b-609b157a55b6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:52 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-439e3000-8c11-4ebf-903b-609b157a55b6 Jul 13 20:44:52 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:52 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c53333-a290-4a87-b23f-2a9865211d1c 1073741824" returned: 0 in 0.419s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c53333-a290-4a87-b23f-2a9865211d1c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:52 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c53333-a290-4a87-b23f-2a9865211d1c Jul 13 20:44:52 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:52 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-439e3000-8c11-4ebf-903b-609b157a55b6" returned: 0 in 0.267s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-quobyte-439e3000-8c11-4ebf-903b-609b157a55b6" released by "delete_volume" :: held 0.665s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] Created reservations ['f295bf65-4e1e-4dfe-863c-5a0eea06b55a', 'e96bb6fe-ac5e-4a73-ad5c-bce3108f5408', '7c5e99a6-27c6-433d-8304-d1940ffcf560', 'aa220647-c5b2-44f2-a1f8-35eb187b1cef'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:52 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:44:52 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:52 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c53333-a290-4a87-b23f-2a9865211d1c" returned: 0 in 0.258s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4c2185-16ed-4bf2-b81a-2735aa014678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1c53333-a290-4a87-b23f-2a9865211d1c', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4376b5b-f395-4f2b-915c-24bfacb89025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:52 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Volume volume-f1c53333-a290-4a87-b23f-2a9865211d1c (f1c53333-a290-4a87-b23f-2a9865211d1c): created successfully Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4376b5b-f395-4f2b-915c-24bfacb89025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Flow 'volume_create_manager' (4d73632c-3f27-4771-aa7f-4733a01ebd03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:52 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-605a0688-56fc-447e-839b-aa53b639e055 tempest-VolumesListAdminTestJSON-1585528644 None] Created volume successfully. Jul 13 20:44:52 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.286s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:44:52 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] Deleted volume successfully. Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f2cf82b-222b-4ad3-a063-29e981cc8560 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-439e3000-8c11-4ebf-903b-609b157a55b6-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "cinder-0c63b2ca-ae29-4486-a3ac-9f98d7245012-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-0c63b2ca-ae29-4486-a3ac-9f98d7245012-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "cinder-quobyte-0c63b2ca-ae29-4486-a3ac-9f98d7245012" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-quobyte-0c63b2ca-ae29-4486-a3ac-9f98d7245012" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c5c971-3ea0-4fa9-addf-cc4a1a2e43f5]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c63b2ca-ae29-4486-a3ac-9f98d7245012 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:53 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c63b2ca-ae29-4486-a3ac-9f98d7245012 Jul 13 20:44:53 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:53 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c63b2ca-ae29-4486-a3ac-9f98d7245012" returned: 0 in 0.375s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c63b2ca-ae29-4486-a3ac-9f98d7245012 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:53 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c63b2ca-ae29-4486-a3ac-9f98d7245012 Jul 13 20:44:53 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Flow 'volume_create_manager' (26b369eb-c54d-4f29-9ad5-7aaf6fb3ec22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e27e1b3-127f-4746-a561-7788d7d2bf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e27e1b3-127f-4746-a561-7788d7d2bf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d367b55-6d22-4ba2-b60e-e544569c06a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f745ff64604f1c9973824b33fbb57d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:54Z,use_quota=True,user_id='dc3a4b068747467ebceaef2c73a74160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b21281e-8565-4abe-a15c-a2aea0ae1094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b21281e-8565-4abe-a15c-a2aea0ae1094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd41dbd-a56a-4eb7-9707-6b0b72ab5026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd41dbd-a56a-4eb7-9707-6b0b72ab5026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d367b55-6d22-4ba2-b60e-e544569c06a8', 'volume_name': 'volume-4d367b55-6d22-4ba2-b60e-e544569c06a8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ecf61c8-88b1-4463-8fc2-1ba1f5863365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ecf61c8-88b1-4463-8fc2-1ba1f5863365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5a4973-4b0a-4d39-bc4d-19ff91548cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:53 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Volume 4d367b55-6d22-4ba2-b60e-e544569c06a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d367b55-6d22-4ba2-b60e-e544569c06a8', 'volume_size': 1} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d367b55-6d22-4ba2-b60e-e544569c06a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f745ff64604f1c9973824b33fbb57d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:44:54Z,use_quota=True,user_id='dc3a4b068747467ebceaef2c73a74160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Creating volume 4d367b55-6d22-4ba2-b60e-e544569c06a8 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:44:53 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4d367b55-6d22-4ba2-b60e-e544569c06a8 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:53 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c63b2ca-ae29-4486-a3ac-9f98d7245012" returned: 0 in 0.268s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-quobyte-0c63b2ca-ae29-4486-a3ac-9f98d7245012" released by "delete_volume" :: held 0.688s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:53 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4d367b55-6d22-4ba2-b60e-e544569c06a8 1073741824 Jul 13 20:44:53 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] Created reservations ['99b35626-e766-42bc-bb9e-b9a3fff1c0b9', '2908942c-1ddf-4c0b-9945-02bb789efc5d', '8b49cd08-b74b-4059-8ba4-9df65864d76a', 'c695506b-7240-4a39-8c74-2a8ddec9caf6'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:53 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:44:53 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:54 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.264s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:44:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] Deleted volume successfully. Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "cinder-a7e98d69-0458-4396-af65-c34e31fcf00f-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5696330d-7163-4f69-ad89-e0f5ddec0851 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-0c63b2ca-ae29-4486-a3ac-9f98d7245012-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-a7e98d69-0458-4396-af65-c34e31fcf00f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "cinder-quobyte-a7e98d69-0458-4396-af65-c34e31fcf00f" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:54 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-quobyte-a7e98d69-0458-4396-af65-c34e31fcf00f" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4d367b55-6d22-4ba2-b60e-e544569c06a8 1073741824" returned: 0 in 0.518s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe147e66-1ffa-4819-92e7-47f0d9946ec7]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a7e98d69-0458-4396-af65-c34e31fcf00f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4d367b55-6d22-4ba2-b60e-e544569c06a8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:54 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4d367b55-6d22-4ba2-b60e-e544569c06a8 Jul 13 20:44:54 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:54 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a7e98d69-0458-4396-af65-c34e31fcf00f Jul 13 20:44:54 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:54 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4d367b55-6d22-4ba2-b60e-e544569c06a8" returned: 0 in 0.262s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5a4973-4b0a-4d39-bc4d-19ff91548cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d367b55-6d22-4ba2-b60e-e544569c06a8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f42731-602c-4e1a-88cd-86625f39a562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:44:54 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Volume volume-4d367b55-6d22-4ba2-b60e-e544569c06a8 (4d367b55-6d22-4ba2-b60e-e544569c06a8): created successfully Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f42731-602c-4e1a-88cd-86625f39a562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Flow 'volume_create_manager' (26b369eb-c54d-4f29-9ad5-7aaf6fb3ec22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:44:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-012231d2-1e08-4b3f-b2f9-eabf2cf1cf73 tempest-VolumesListAdminTestJSON-1010744049 None] Created volume successfully. Jul 13 20:44:54 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a7e98d69-0458-4396-af65-c34e31fcf00f" returned: 0 in 0.392s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a7e98d69-0458-4396-af65-c34e31fcf00f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:54 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a7e98d69-0458-4396-af65-c34e31fcf00f Jul 13 20:44:54 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:54 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a7e98d69-0458-4396-af65-c34e31fcf00f" returned: 0 in 0.238s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-quobyte-a7e98d69-0458-4396-af65-c34e31fcf00f" released by "delete_volume" :: held 0.670s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] Created reservations ['b12cd0ad-16c2-49fc-92ac-6dab02229050', 'e09edb6d-acf2-4db6-8983-e5df5cb00d63', 'da99abf2-5e20-464a-a9dd-54ad44fbca12', '5c24a54c-fca9-499e-8564-5f26ce3c8e2a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:55 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:44:55 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:55 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.239s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:44:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] Deleted volume successfully. Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f2ed250e-51ba-4946-b658-c464af03400a tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-a7e98d69-0458-4396-af65-c34e31fcf00f-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "cinder-220145c9-17da-479f-ba5c-207de71899c4-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-220145c9-17da-479f-ba5c-207de71899c4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "cinder-quobyte-220145c9-17da-479f-ba5c-207de71899c4" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-quobyte-220145c9-17da-479f-ba5c-207de71899c4" acquired by "delete_volume" :: waited 0.012s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8094af-f57f-4dad-80d0-7a0aa4d9ff09]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-220145c9-17da-479f-ba5c-207de71899c4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:55 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-220145c9-17da-479f-ba5c-207de71899c4 Jul 13 20:44:55 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:55 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-220145c9-17da-479f-ba5c-207de71899c4" returned: 0 in 0.373s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-220145c9-17da-479f-ba5c-207de71899c4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:55 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-220145c9-17da-479f-ba5c-207de71899c4 Jul 13 20:44:55 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] Acquiring lock "cinder-4d367b55-6d22-4ba2-b60e-e544569c06a8-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] Lock "cinder-4d367b55-6d22-4ba2-b60e-e544569c06a8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] Acquiring lock "cinder-quobyte-4d367b55-6d22-4ba2-b60e-e544569c06a8" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] Lock "cinder-quobyte-4d367b55-6d22-4ba2-b60e-e544569c06a8" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1ec03d-c511-4696-bae5-43812729e99a]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4d367b55-6d22-4ba2-b60e-e544569c06a8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] Acquiring lock "cinder-f1c53333-a290-4a87-b23f-2a9865211d1c-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "cinder-f1c53333-a290-4a87-b23f-2a9865211d1c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] Acquiring lock "cinder-quobyte-f1c53333-a290-4a87-b23f-2a9865211d1c" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "cinder-quobyte-f1c53333-a290-4a87-b23f-2a9865211d1c" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:56 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-220145c9-17da-479f-ba5c-207de71899c4" returned: 0 in 0.292s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a21323f-1c52-4ccd-80b2-ded225e4d329]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c53333-a290-4a87-b23f-2a9865211d1c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:56 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4d367b55-6d22-4ba2-b60e-e544569c06a8 Jul 13 20:44:56 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-quobyte-220145c9-17da-479f-ba5c-207de71899c4" released by "delete_volume" :: held 0.711s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] Created reservations ['724755e1-0129-4a35-a778-e5b1d222680c', '85aed03c-f256-425a-be42-173e7fbb4b39', '924791bd-0b78-4dcb-8e65-3f15871f528d', '1cdae2d3-3123-4902-bf6d-e54f5e178d3d'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:56 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c53333-a290-4a87-b23f-2a9865211d1c Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:56 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:56 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:44:56 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:56 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4d367b55-6d22-4ba2-b60e-e544569c06a8" returned: 0 in 0.430s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4d367b55-6d22-4ba2-b60e-e544569c06a8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:56 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4d367b55-6d22-4ba2-b60e-e544569c06a8 Jul 13 20:44:56 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:56 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c53333-a290-4a87-b23f-2a9865211d1c" returned: 0 in 0.395s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c53333-a290-4a87-b23f-2a9865211d1c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:56 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "cinder-7ade3fd2-4f21-4b2b-b802-69facdd87116-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.310s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:56 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c53333-a290-4a87-b23f-2a9865211d1c Jul 13 20:44:56 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:44:56 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] Deleted volume successfully. Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-7ade3fd2-4f21-4b2b-b802-69facdd87116-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4105c645-5822-4183-bca1-938410b34f71 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-220145c9-17da-479f-ba5c-207de71899c4-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "cinder-quobyte-7ade3fd2-4f21-4b2b-b802-69facdd87116" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-quobyte-7ade3fd2-4f21-4b2b-b802-69facdd87116" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcec201-0129-4afb-a533-dbb833e7047e]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7ade3fd2-4f21-4b2b-b802-69facdd87116 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:56 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4d367b55-6d22-4ba2-b60e-e544569c06a8" returned: 0 in 0.306s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] Lock "cinder-quobyte-4d367b55-6d22-4ba2-b60e-e544569c06a8" released by "delete_volume" :: held 0.788s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] Created reservations ['47f20be5-e9c4-46e4-82a3-9f636e8ab039', 'dc50447f-c301-4bf2-9cca-c6f463ed2b64', '91183965-c8f4-499c-a216-85075053ab30', 'cca5ba24-fbe6-453d-96d3-5d2c920617ef'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:56 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7ade3fd2-4f21-4b2b-b802-69facdd87116 Jul 13 20:44:56 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:56 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c53333-a290-4a87-b23f-2a9865211d1c" returned: 0 in 0.292s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "cinder-quobyte-f1c53333-a290-4a87-b23f-2a9865211d1c" released by "delete_volume" :: held 0.750s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:56 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:44:56 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:56 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] Created reservations ['ef2c41b2-7212-4cd2-bc03-8d041c74c44c', 'b5adbc9b-288c-4252-a611-49e92dfa26cc', 'f3c38da3-47a4-4da7-a717-a0d1f90ae1b1', '600234fb-c535-45e8-91c0-311ba5d08b53'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:57 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:44:57 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:57 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7ade3fd2-4f21-4b2b-b802-69facdd87116" returned: 0 in 0.445s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7ade3fd2-4f21-4b2b-b802-69facdd87116 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:57 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7ade3fd2-4f21-4b2b-b802-69facdd87116 Jul 13 20:44:57 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:57 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.278s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:44:57 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] Deleted volume successfully. Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5c02732b-3b52-4f13-984d-977877122a5a tempest-VolumesListAdminTestJSON-1010744049 None] Lock "cinder-4d367b55-6d22-4ba2-b60e-e544569c06a8-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] Acquiring lock "cinder-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "cinder-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] Acquiring lock "cinder-quobyte-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "cinder-quobyte-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:57 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.321s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:44:57 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] Deleted volume successfully. Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2d4e45-57ad-4b68-9120-240c9857c708]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-602ed265-b249-4f95-92ed-9ae2a02b36e7 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "cinder-f1c53333-a290-4a87-b23f-2a9865211d1c-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:57 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7ade3fd2-4f21-4b2b-b802-69facdd87116" returned: 0 in 0.312s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-quobyte-7ade3fd2-4f21-4b2b-b802-69facdd87116" released by "delete_volume" :: held 0.800s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] Created reservations ['53296bd2-9352-46d0-a5d9-9a46bb861bad', '977bc0b0-bbfd-4bac-b345-6b45cc0b5868', '2032baed-335c-4f34-9c2e-cf5cc77e1018', '249c3a39-4110-4a7c-ad8c-e9479b3617f2'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:57 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832 Jul 13 20:44:57 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:57 devstack sudo[102840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:44:57 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "cinder-69af0924-96d4-4f63-bedb-48966e1a772d-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-69af0924-96d4-4f63-bedb-48966e1a772d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "cinder-quobyte-53cedf37-032a-4a2c-a0f1-a3ea64e69891" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-quobyte-53cedf37-032a-4a2c-a0f1-a3ea64e69891" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "cinder-quobyte-69af0924-96d4-4f63-bedb-48966e1a772d" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-quobyte-69af0924-96d4-4f63-bedb-48966e1a772d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] Deleting offline snapshot 69af0924-96d4-4f63-bedb-48966e1a772d of volume 53cedf37-032a-4a2c-a0f1-a3ea64e69891 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] snapshot_file for this snap is: volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[96943a1e-6658-4cb3-ab7d-eabc0551727c]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:57 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832" returned: 0 in 0.430s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:57 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.276s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:44:57 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] Deleted volume successfully. Jul 13 20:44:57 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832 Jul 13 20:44:57 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c4e58d0f-24c8-4389-9f6f-b86e4b6e4d46 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-7ade3fd2-4f21-4b2b-b802-69facdd87116-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:57 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d Jul 13 20:44:57 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:58 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832" returned: 0 in 0.261s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "cinder-quobyte-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832" released by "delete_volume" :: held 0.745s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] Created reservations ['f6c5170d-daa5-4162-a54b-f6c4cb2ef0d1', '7d8b455a-1c35-4812-8faf-ef344834707c', '81f5734d-7ba3-4c21-bcc8-d183e2fe97fa', '49562f32-26bc-464d-8b60-eee4fd5a6be0'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:58 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d" returned: 0 in 0.374s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3dc1c1-4328-438a-9c46-eccbac58be52]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:58 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:44:58 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:58 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891 Jul 13 20:44:58 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:58 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.253s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] Acquiring lock "cinder-9292192e-6dad-4d16-8caa-a72df06dca97-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:58 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] Deleted volume successfully. Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] Lock "cinder-9292192e-6dad-4d16-8caa-a72df06dca97-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8f87c8f4-087f-4cc8-8146-b4d585237218 tempest-VolumesListAdminTestJSON-1585528644 None] Lock "cinder-c6533c05-6e77-4e7d-b8a1-4e4dcb5c5832-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] Acquiring lock "cinder-quobyte-9292192e-6dad-4d16-8caa-a72df06dca97" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] Lock "cinder-quobyte-9292192e-6dad-4d16-8caa-a72df06dca97" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3ec07d-b958-4b97-ac28-fda13abc763e]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9292192e-6dad-4d16-8caa-a72df06dca97 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:58 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891" returned: 0 in 0.427s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:58 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d Jul 13 20:44:58 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:58 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9292192e-6dad-4d16-8caa-a72df06dca97 Jul 13 20:44:58 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:58 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d" returned: 0 in 0.340s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:58 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9292192e-6dad-4d16-8caa-a72df06dca97" returned: 0 in 0.370s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9292192e-6dad-4d16-8caa-a72df06dca97 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:58 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d Jul 13 20:44:58 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:58 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9292192e-6dad-4d16-8caa-a72df06dca97 Jul 13 20:44:58 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:59 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891.69af0924-96d4-4f63-bedb-48966e1a772d" returned: 0 in 0.248s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-quobyte-69af0924-96d4-4f63-bedb-48966e1a772d" released by "_delete_snapshot" :: held 1.495s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:59 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-quobyte-53cedf37-032a-4a2c-a0f1-a3ea64e69891" released by "delete_snapshot" :: held 1.522s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9292192e-6dad-4d16-8caa-a72df06dca97" returned: 0 in 0.281s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] Lock "cinder-quobyte-9292192e-6dad-4d16-8caa-a72df06dca97" released by "delete_volume" :: held 0.696s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] Created reservations ['5515ef13-d9c7-4b37-b3b7-736a140896a4', 'acbc526a-749f-4ef9-b7b8-524806622d66', '1065a4db-db04-4ef8-acbe-ed006fde3579', 'b0f11baf-e650-49d1-885f-52252fddc483'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] Created reservations ['77be1896-79d4-4efd-8ee6-655e9a4706d7', '95492d10-ada9-4d53-ae93-f91786fac03a', 'e469226b-1673-4758-b3b7-a313abc5dce5', '54a061b6-3290-433b-a3f1-fe766c2fa269'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:44:59 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] Delete snapshot completed successfully. Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a05244ba-f941-4610-b5b1-06518891e99f tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-69af0924-96d4-4f63-bedb-48966e1a772d-delete_snapshot" released by "delete_snapshot" :: held 1.691s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:44:59 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:44:59 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:44:59 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.270s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:44:59 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] Deleted volume successfully. Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b7c61a8c-92a9-4bb9-a6f0-493cd0c11abc tempest-VolumesListAdminTestJSON-1585528644 None] Lock "cinder-9292192e-6dad-4d16-8caa-a72df06dca97-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "cinder-53cedf37-032a-4a2c-a0f1-a3ea64e69891-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-53cedf37-032a-4a2c-a0f1-a3ea64e69891-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "cinder-quobyte-53cedf37-032a-4a2c-a0f1-a3ea64e69891" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-quobyte-53cedf37-032a-4a2c-a0f1-a3ea64e69891" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4daade-1804-460d-9f23-4442e10db727]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:44:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:00 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891 Jul 13 20:45:00 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:00 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891" returned: 0 in 0.396s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:00 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891 Jul 13 20:45:00 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:00 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-53cedf37-032a-4a2c-a0f1-a3ea64e69891" returned: 0 in 0.268s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-quobyte-53cedf37-032a-4a2c-a0f1-a3ea64e69891" released by "delete_volume" :: held 0.729s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:00 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Created reservations ['e0514bed-617b-41d1-9ee5-f04ad5aef251', '3f265a9d-73ca-452b-b0fa-3a9329933af7', 'a942b812-c319-4a43-b6e2-ec3bc26f3f90', '82ac8383-c2fe-48b3-8b81-8a7d52a524a7'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:45:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:00 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:45:00 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:01 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.254s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:45:01 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Deleted volume successfully. Jul 13 20:45:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a2831a35-fa3c-4ace-aeed-d11a96e3c0d7 tempest-CreateVolumesFromSnapshotTest-52661885 None] Lock "cinder-53cedf37-032a-4a2c-a0f1-a3ea64e69891-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=145,cinder:UPDATE=201,cinder:DELETE=15,cinder:INSERT=49 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Flow 'volume_create_manager' (aba83fac-0b7f-4322-bc53-b5c68a2e6532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae62a2e-0111-4a02-b100-2811d7d1844e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae62a2e-0111-4a02-b100-2811d7d1844e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2032556471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8500642-15a9-45e6-b640-518e902c207b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d93468058141378972bdd28359a759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:04Z,use_quota=True,user_id='244cb73fa2144fa7b13d3a6735351c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81042537-50a2-4322-9c43-b2bfbad0c3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81042537-50a2-4322-9c43-b2bfbad0c3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06396d4e-f7e8-4c11-9b83-6c5bbe5b5be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06396d4e-f7e8-4c11-9b83-6c5bbe5b5be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8500642-15a9-45e6-b640-518e902c207b', 'volume_name': 'volume-a8500642-15a9-45e6-b640-518e902c207b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9dc8bb2-c750-4217-a442-7ad14dd5a4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9dc8bb2-c750-4217-a442-7ad14dd5a4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6571bd0-aaa9-41d1-980c-f9b471583c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Volume a8500642-15a9-45e6-b640-518e902c207b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8500642-15a9-45e6-b640-518e902c207b', 'volume_size': 1} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2032556471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8500642-15a9-45e6-b640-518e902c207b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d93468058141378972bdd28359a759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:04Z,use_quota=True,user_id='244cb73fa2144fa7b13d3a6735351c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Creating volume a8500642-15a9-45e6-b640-518e902c207b {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:45:04 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a8500642-15a9-45e6-b640-518e902c207b 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:04 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a8500642-15a9-45e6-b640-518e902c207b 1073741824 Jul 13 20:45:04 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:04 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a8500642-15a9-45e6-b640-518e902c207b 1073741824" returned: 0 in 0.452s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a8500642-15a9-45e6-b640-518e902c207b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:04 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a8500642-15a9-45e6-b640-518e902c207b Jul 13 20:45:04 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:04 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a8500642-15a9-45e6-b640-518e902c207b" returned: 0 in 0.272s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:45:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6571bd0-aaa9-41d1-980c-f9b471583c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8500642-15a9-45e6-b640-518e902c207b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eea821d-ef3d-4b92-8b4f-aecfc1efd1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Volume volume-a8500642-15a9-45e6-b640-518e902c207b (a8500642-15a9-45e6-b640-518e902c207b): created successfully Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eea821d-ef3d-4b92-8b4f-aecfc1efd1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Flow 'volume_create_manager' (aba83fac-0b7f-4322-bc53-b5c68a2e6532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e76a3d63-75b1-4532-96f4-29cf2178c55d tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Created volume successfully. Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Flow 'volume_create_manager' (cb90d4cf-8e5b-4c68-8d00-e40e7e91ee8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6526d8f7-768b-4d8f-8663-5687da4e1854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6526d8f7-768b-4d8f-8663-5687da4e1854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1996953788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7603d28-d4f7-42f5-84f9-0d259aa93579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d93468058141378972bdd28359a759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:06Z,use_quota=True,user_id='244cb73fa2144fa7b13d3a6735351c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da58fae7-2c40-4028-b970-1bbba32c303a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da58fae7-2c40-4028-b970-1bbba32c303a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da39e69a-0767-49a8-b143-13ffc4918dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da39e69a-0767-49a8-b143-13ffc4918dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7603d28-d4f7-42f5-84f9-0d259aa93579', 'volume_name': 'volume-e7603d28-d4f7-42f5-84f9-0d259aa93579', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2285ef64-54ac-4409-bd39-79d02f242b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2285ef64-54ac-4409-bd39-79d02f242b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a146a923-5b10-4691-a197-1bff47e1888a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Volume e7603d28-d4f7-42f5-84f9-0d259aa93579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7603d28-d4f7-42f5-84f9-0d259aa93579', 'volume_size': 1} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1996953788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7603d28-d4f7-42f5-84f9-0d259aa93579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d93468058141378972bdd28359a759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:06Z,use_quota=True,user_id='244cb73fa2144fa7b13d3a6735351c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Creating volume e7603d28-d4f7-42f5-84f9-0d259aa93579 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:45:05 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:45:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7603d28-d4f7-42f5-84f9-0d259aa93579 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:05 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7603d28-d4f7-42f5-84f9-0d259aa93579 1073741824 Jul 13 20:45:05 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Flow 'volume_create_manager' (6fd2bdda-6035-4ddb-bf08-2611f8a55278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29044c3a-bbe8-49b4-940f-1f997c43ff8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29044c3a-bbe8-49b4-940f-1f997c43ff8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-919726426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d93468058141378972bdd28359a759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:06Z,use_quota=True,user_id='244cb73fa2144fa7b13d3a6735351c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f6fe03-5594-4a17-9aa4-0c4a3cf9a2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f6fe03-5594-4a17-9aa4-0c4a3cf9a2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af32cc1-bcec-46e3-ac73-2ab00553c537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af32cc1-bcec-46e3-ac73-2ab00553c537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6', 'volume_name': 'volume-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2518eb9c-3bf9-4502-9a83-970460042545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2518eb9c-3bf9-4502-9a83-970460042545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d86a45e-88e5-4fda-935e-3bda682f36d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:06 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Volume f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6', 'volume_size': 1} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:06 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7603d28-d4f7-42f5-84f9-0d259aa93579 1073741824" returned: 0 in 0.602s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7603d28-d4f7-42f5-84f9-0d259aa93579 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:06 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7603d28-d4f7-42f5-84f9-0d259aa93579 Jul 13 20:45:06 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Flow 'volume_create_manager' (cc7e8842-65b3-498a-bd3d-c83cac0f30f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0bfc70-990a-409f-ab71-e4fdeb2bf0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0bfc70-990a-409f-ab71-e4fdeb2bf0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1104003644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac4e2304-a9a6-43b6-8785-03ad47ef702a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d93468058141378972bdd28359a759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:06Z,use_quota=True,user_id='244cb73fa2144fa7b13d3a6735351c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0f7749-2f5f-4f03-a155-1aca6a29094e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0f7749-2f5f-4f03-a155-1aca6a29094e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62f87f88-edfa-4c3f-b15e-a613fa8b1ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62f87f88-edfa-4c3f-b15e-a613fa8b1ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac4e2304-a9a6-43b6-8785-03ad47ef702a', 'volume_name': 'volume-ac4e2304-a9a6-43b6-8785-03ad47ef702a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b538517f-572b-4438-8f1e-dee21d0f7ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b538517f-572b-4438-8f1e-dee21d0f7ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b33eee-eb96-4810-a013-1a758ae0a149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:06 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Volume ac4e2304-a9a6-43b6-8785-03ad47ef702a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac4e2304-a9a6-43b6-8785-03ad47ef702a', 'volume_size': 1} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:06 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7603d28-d4f7-42f5-84f9-0d259aa93579" returned: 0 in 0.363s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.571s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-919726426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d93468058141378972bdd28359a759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:06Z,use_quota=True,user_id='244cb73fa2144fa7b13d3a6735351c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Creating volume f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:45:06 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a146a923-5b10-4691-a197-1bff47e1888a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7603d28-d4f7-42f5-84f9-0d259aa93579', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:06 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6 1073741824 Jul 13 20:45:06 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab40b4eb-cded-4a30-8452-c305e6434e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:06 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Volume volume-e7603d28-d4f7-42f5-84f9-0d259aa93579 (e7603d28-d4f7-42f5-84f9-0d259aa93579): created successfully Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab40b4eb-cded-4a30-8452-c305e6434e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Flow 'volume_create_manager' (cb90d4cf-8e5b-4c68-8d00-e40e7e91ee8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-bfe40df8-6c22-412b-9519-e06b3805a113 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Created volume successfully. Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Flow 'volume_create_manager' (386a5428-f53b-49f3-b7fd-f95d561ec8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3cdf340-5d3b-4b55-b298-926addbe1af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3cdf340-5d3b-4b55-b298-926addbe1af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1242898247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba87ab4-0da2-42ad-9866-7aca68cdfb24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52e32cd71c5b47b48c3b5450ad388861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:07Z,use_quota=True,user_id='c6b8654e341343b3bd59399aa7e8f35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c26cf3a-9676-4671-92b7-54c5cae9eedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c26cf3a-9676-4671-92b7-54c5cae9eedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0d3ac6-a997-4556-8ae9-a4373cc33190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0d3ac6-a997-4556-8ae9-a4373cc33190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba87ab4-0da2-42ad-9866-7aca68cdfb24', 'volume_name': 'volume-bba87ab4-0da2-42ad-9866-7aca68cdfb24', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3af5013-0c29-427f-8d74-9e1f4be0679f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3af5013-0c29-427f-8d74-9e1f4be0679f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4411f1f4-8c69-4c6f-90b6-09d8a5c0a2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:07 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Volume bba87ab4-0da2-42ad-9866-7aca68cdfb24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba87ab4-0da2-42ad-9866-7aca68cdfb24', 'volume_size': 1} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Flow 'volume_create_manager' (aeaeeea4-e1e5-4b53-b7da-441a83e68cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388e83d5-b532-4b69-9b8b-98a97a3a366f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:07 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388e83d5-b532-4b69-9b8b-98a97a3a366f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1438284553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52dfb025-95e4-4e73-86c6-bb9516463771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d93468058141378972bdd28359a759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:07Z,use_quota=True,user_id='244cb73fa2144fa7b13d3a6735351c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aae9fdd-58a5-4c9c-b41b-b29b5c46801d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aae9fdd-58a5-4c9c-b41b-b29b5c46801d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ac8ce2-fb65-408f-b306-19df0d0aa347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ac8ce2-fb65-408f-b306-19df0d0aa347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52dfb025-95e4-4e73-86c6-bb9516463771', 'volume_name': 'volume-52dfb025-95e4-4e73-86c6-bb9516463771', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3787b82c-4a77-4f2a-9a1e-ca56d2f58cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3787b82c-4a77-4f2a-9a1e-ca56d2f58cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14e9f57-6156-4b27-ba56-21e45a454873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:07 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Volume 52dfb025-95e4-4e73-86c6-bb9516463771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52dfb025-95e4-4e73-86c6-bb9516463771', 'volume_size': 1} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6 1073741824" returned: 0 in 0.582s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Flow 'volume_create_manager' (5164b7f4-3b4b-4016-a5cc-b846364e2dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20074ab-15ef-42fb-bf97-f2b2276af792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20074ab-15ef-42fb-bf97-f2b2276af792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1280262973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f829c81d-9b49-4792-94a4-b24f1985158a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d93468058141378972bdd28359a759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:07Z,use_quota=True,user_id='244cb73fa2144fa7b13d3a6735351c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83920cc4-6f8a-4bc9-a916-4442b9e25c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83920cc4-6f8a-4bc9-a916-4442b9e25c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4841e223-e41c-4225-b05c-b72060d7e8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4841e223-e41c-4225-b05c-b72060d7e8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f829c81d-9b49-4792-94a4-b24f1985158a', 'volume_name': 'volume-f829c81d-9b49-4792-94a4-b24f1985158a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fba0221-4bc2-4712-bb5a-f1c06e780026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fba0221-4bc2-4712-bb5a-f1c06e780026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97fb44ca-348b-4401-849f-320a0e1f286e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:07 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Volume f829c81d-9b49-4792-94a4-b24f1985158a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f829c81d-9b49-4792-94a4-b24f1985158a', 'volume_size': 1} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:07 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6 Jul 13 20:45:07 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:07 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6" returned: 0 in 0.253s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.104s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1104003644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac4e2304-a9a6-43b6-8785-03ad47ef702a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d93468058141378972bdd28359a759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:06Z,use_quota=True,user_id='244cb73fa2144fa7b13d3a6735351c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Creating volume ac4e2304-a9a6-43b6-8785-03ad47ef702a {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:45:07 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ac4e2304-a9a6-43b6-8785-03ad47ef702a 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:07 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ac4e2304-a9a6-43b6-8785-03ad47ef702a 1073741824 Jul 13 20:45:07 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d86a45e-88e5-4fda-935e-3bda682f36d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94378765-3d7d-4e94-8774-37d8a6e90c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:07 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Volume volume-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6 (f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6): created successfully Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94378765-3d7d-4e94-8774-37d8a6e90c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Flow 'volume_create_manager' (6fd2bdda-6035-4ddb-bf08-2611f8a55278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a4a62a6e-53fc-42bc-99a3-0be9fcddd494 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Created volume successfully. Jul 13 20:45:08 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ac4e2304-a9a6-43b6-8785-03ad47ef702a 1073741824" returned: 0 in 0.415s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ac4e2304-a9a6-43b6-8785-03ad47ef702a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:08 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ac4e2304-a9a6-43b6-8785-03ad47ef702a Jul 13 20:45:08 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:08 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ac4e2304-a9a6-43b6-8785-03ad47ef702a" returned: 0 in 0.252s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.308s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1242898247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba87ab4-0da2-42ad-9866-7aca68cdfb24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52e32cd71c5b47b48c3b5450ad388861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:07Z,use_quota=True,user_id='c6b8654e341343b3bd59399aa7e8f35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Creating volume bba87ab4-0da2-42ad-9866-7aca68cdfb24 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:45:08 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-bba87ab4-0da2-42ad-9866-7aca68cdfb24 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b33eee-eb96-4810-a013-1a758ae0a149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac4e2304-a9a6-43b6-8785-03ad47ef702a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f3e783-bd6d-4dae-a57b-e5219c503d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:08 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-bba87ab4-0da2-42ad-9866-7aca68cdfb24 1073741824 Jul 13 20:45:08 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:08 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Volume volume-ac4e2304-a9a6-43b6-8785-03ad47ef702a (ac4e2304-a9a6-43b6-8785-03ad47ef702a): created successfully Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f3e783-bd6d-4dae-a57b-e5219c503d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Flow 'volume_create_manager' (cc7e8842-65b3-498a-bd3d-c83cac0f30f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-136e290e-7b99-4863-bec6-cabb79aa98b9 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Created volume successfully. Jul 13 20:45:08 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-bba87ab4-0da2-42ad-9866-7aca68cdfb24 1073741824" returned: 0 in 0.409s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-bba87ab4-0da2-42ad-9866-7aca68cdfb24 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:08 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-bba87ab4-0da2-42ad-9866-7aca68cdfb24 Jul 13 20:45:08 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:09 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-bba87ab4-0da2-42ad-9866-7aca68cdfb24" returned: 0 in 0.235s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.760s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1438284553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52dfb025-95e4-4e73-86c6-bb9516463771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d93468058141378972bdd28359a759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:07Z,use_quota=True,user_id='244cb73fa2144fa7b13d3a6735351c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Creating volume 52dfb025-95e4-4e73-86c6-bb9516463771 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:45:09 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52dfb025-95e4-4e73-86c6-bb9516463771 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4411f1f4-8c69-4c6f-90b6-09d8a5c0a2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba87ab4-0da2-42ad-9866-7aca68cdfb24', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:09 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52dfb025-95e4-4e73-86c6-bb9516463771 1073741824 Jul 13 20:45:09 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460dceba-4de1-4bae-a624-d399e3862ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:09 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Volume volume-bba87ab4-0da2-42ad-9866-7aca68cdfb24 (bba87ab4-0da2-42ad-9866-7aca68cdfb24): created successfully Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460dceba-4de1-4bae-a624-d399e3862ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Flow 'volume_create_manager' (386a5428-f53b-49f3-b7fd-f95d561ec8a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-671bd1c7-9879-4d9f-883e-3299121fe6b5 tempest-VolumesMetadataTest-1405795860 None] Created volume successfully. Jul 13 20:45:09 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52dfb025-95e4-4e73-86c6-bb9516463771 1073741824" returned: 0 in 0.401s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52dfb025-95e4-4e73-86c6-bb9516463771 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:09 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52dfb025-95e4-4e73-86c6-bb9516463771 Jul 13 20:45:09 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:09 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52dfb025-95e4-4e73-86c6-bb9516463771" returned: 0 in 0.234s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.342s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1280262973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f829c81d-9b49-4792-94a4-b24f1985158a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d93468058141378972bdd28359a759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:07Z,use_quota=True,user_id='244cb73fa2144fa7b13d3a6735351c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Creating volume f829c81d-9b49-4792-94a4-b24f1985158a {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:45:09 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f829c81d-9b49-4792-94a4-b24f1985158a 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14e9f57-6156-4b27-ba56-21e45a454873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52dfb025-95e4-4e73-86c6-bb9516463771', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8528c85a-3e7b-4960-85a6-fcb1929215d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:09 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f829c81d-9b49-4792-94a4-b24f1985158a 1073741824 Jul 13 20:45:09 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:09 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Volume volume-52dfb025-95e4-4e73-86c6-bb9516463771 (52dfb025-95e4-4e73-86c6-bb9516463771): created successfully Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8528c85a-3e7b-4960-85a6-fcb1929215d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Flow 'volume_create_manager' (aeaeeea4-e1e5-4b53-b7da-441a83e68cdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-be11ba09-9e4a-45f6-a062-7b430f64cde2 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Created volume successfully. Jul 13 20:45:10 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f829c81d-9b49-4792-94a4-b24f1985158a 1073741824" returned: 0 in 0.463s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f829c81d-9b49-4792-94a4-b24f1985158a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:10 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f829c81d-9b49-4792-94a4-b24f1985158a Jul 13 20:45:10 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:10 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f829c81d-9b49-4792-94a4-b24f1985158a" returned: 0 in 0.256s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:45:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97fb44ca-348b-4401-849f-320a0e1f286e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f829c81d-9b49-4792-94a4-b24f1985158a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9539186-88fc-4bff-bbdb-f2510aa49388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:10 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Volume volume-f829c81d-9b49-4792-94a4-b24f1985158a (f829c81d-9b49-4792-94a4-b24f1985158a): created successfully Jul 13 20:45:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9539186-88fc-4bff-bbdb-f2510aa49388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Flow 'volume_create_manager' (5164b7f4-3b4b-4016-a5cc-b846364e2dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:10 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a088f816-706a-43ed-a9e8-d59a71ff6e85 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Created volume successfully. Jul 13 20:45:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] Acquiring lock "cinder-bba87ab4-0da2-42ad-9866-7aca68cdfb24-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] Lock "cinder-bba87ab4-0da2-42ad-9866-7aca68cdfb24-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] Acquiring lock "cinder-quobyte-bba87ab4-0da2-42ad-9866-7aca68cdfb24" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] Lock "cinder-quobyte-bba87ab4-0da2-42ad-9866-7aca68cdfb24" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:10 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2851370f-8895-4880-af47-81a1581498f7]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-bba87ab4-0da2-42ad-9866-7aca68cdfb24 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:10 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-bba87ab4-0da2-42ad-9866-7aca68cdfb24 Jul 13 20:45:10 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:11 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-bba87ab4-0da2-42ad-9866-7aca68cdfb24" returned: 0 in 0.339s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-bba87ab4-0da2-42ad-9866-7aca68cdfb24 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:11 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-bba87ab4-0da2-42ad-9866-7aca68cdfb24 Jul 13 20:45:11 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:11 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-bba87ab4-0da2-42ad-9866-7aca68cdfb24" returned: 0 in 0.238s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] Lock "cinder-quobyte-bba87ab4-0da2-42ad-9866-7aca68cdfb24" released by "delete_volume" :: held 0.614s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=164,cinder:INSERT=50,cinder:UPDATE=204,cinder:DELETE=18 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] Created reservations ['07cdc0ff-35db-4bd0-ac3d-0d2cb7709f0f', '1654eb96-57c7-4800-8826-9cdde7c298fb', '85ecf90d-6d64-4717-96ed-e2a24cf6751b', 'bf8cba44-4c98-48f1-b359-f27fe7da8cb1'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:11 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:45:11 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "cinder-f829c81d-9b49-4792-94a4-b24f1985158a-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:11 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.255s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:45:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] Deleted volume successfully. Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-f829c81d-9b49-4792-94a4-b24f1985158a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8505639d-469e-4038-9e6b-e464fd0ee579 tempest-VolumesMetadataTest-1405795860 None] Lock "cinder-bba87ab4-0da2-42ad-9866-7aca68cdfb24-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "cinder-quobyte-f829c81d-9b49-4792-94a4-b24f1985158a" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-quobyte-f829c81d-9b49-4792-94a4-b24f1985158a" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a620ff6c-fdae-43c9-aa26-6c2ae82aeb3f]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f829c81d-9b49-4792-94a4-b24f1985158a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:11 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f829c81d-9b49-4792-94a4-b24f1985158a Jul 13 20:45:11 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:12 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f829c81d-9b49-4792-94a4-b24f1985158a" returned: 0 in 0.389s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f829c81d-9b49-4792-94a4-b24f1985158a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:12 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f829c81d-9b49-4792-94a4-b24f1985158a Jul 13 20:45:12 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:12 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f829c81d-9b49-4792-94a4-b24f1985158a" returned: 0 in 0.260s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-quobyte-f829c81d-9b49-4792-94a4-b24f1985158a" released by "delete_volume" :: held 0.696s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Created reservations ['dbe428e0-902a-4857-9a72-b863b4af4a25', '0274afda-212c-4146-8d41-3430d14b1c64', '67f5d8b2-77b0-4571-b0a0-30bb726a820c', '17e747bf-54c9-4f28-9416-d85f5e231c73'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:12 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:45:12 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "cinder-52dfb025-95e4-4e73-86c6-bb9516463771-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:12 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.262s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-52dfb025-95e4-4e73-86c6-bb9516463771-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Deleted volume successfully. Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4a329cfd-42fa-48cf-8241-a2f62ccfff10 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-f829c81d-9b49-4792-94a4-b24f1985158a-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "cinder-quobyte-52dfb025-95e4-4e73-86c6-bb9516463771" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-quobyte-52dfb025-95e4-4e73-86c6-bb9516463771" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9d4a78-de08-460b-9e47-d04a99e7876b]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52dfb025-95e4-4e73-86c6-bb9516463771 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:13 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52dfb025-95e4-4e73-86c6-bb9516463771 Jul 13 20:45:13 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:13 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52dfb025-95e4-4e73-86c6-bb9516463771" returned: 0 in 0.387s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52dfb025-95e4-4e73-86c6-bb9516463771 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:13 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52dfb025-95e4-4e73-86c6-bb9516463771 Jul 13 20:45:13 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:13 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-52dfb025-95e4-4e73-86c6-bb9516463771" returned: 0 in 0.252s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-quobyte-52dfb025-95e4-4e73-86c6-bb9516463771" released by "delete_volume" :: held 0.683s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:13 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Created reservations ['21a83754-91d4-4fa6-bd9d-694208c8d5a5', 'c4346169-ee06-449a-b855-faf1ceb5ec70', '7f4dc8df-0146-48ca-8b50-057f266b29c8', '97b4499c-2b42-451a-8256-dabb9cd484f3'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:45:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:13 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:45:13 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:14 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.253s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:45:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Deleted volume successfully. Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-00ee31c3-191e-41ab-93d4-4569ba04f379 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-52dfb025-95e4-4e73-86c6-bb9516463771-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "cinder-ac4e2304-a9a6-43b6-8785-03ad47ef702a-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-ac4e2304-a9a6-43b6-8785-03ad47ef702a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "cinder-quobyte-ac4e2304-a9a6-43b6-8785-03ad47ef702a" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-quobyte-ac4e2304-a9a6-43b6-8785-03ad47ef702a" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0942f856-92c7-44e9-b38e-add7b21d5693]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ac4e2304-a9a6-43b6-8785-03ad47ef702a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:14 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ac4e2304-a9a6-43b6-8785-03ad47ef702a Jul 13 20:45:14 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:14 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ac4e2304-a9a6-43b6-8785-03ad47ef702a" returned: 0 in 0.372s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ac4e2304-a9a6-43b6-8785-03ad47ef702a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:14 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ac4e2304-a9a6-43b6-8785-03ad47ef702a Jul 13 20:45:14 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:14 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ac4e2304-a9a6-43b6-8785-03ad47ef702a" returned: 0 in 0.259s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-quobyte-ac4e2304-a9a6-43b6-8785-03ad47ef702a" released by "delete_volume" :: held 0.676s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Created reservations ['1cd7593b-3d5e-48de-8ce2-e4870a0ea506', '70827a2a-c1f0-42a1-a193-c9a995f9c73d', '0e70a984-3a19-44ba-96eb-f76c94f4d234', '90c61666-c001-460e-81c8-857fabf3a7c3'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:14 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:45:14 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:15 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.269s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:15 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:45:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Deleted volume successfully. Jul 13 20:45:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec39800d-848c-4a1c-ac4f-59d34656fdaf tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-ac4e2304-a9a6-43b6-8785-03ad47ef702a-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "cinder-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "cinder-quobyte-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-quobyte-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:15 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac48ce5-74fc-45e4-bbba-580551fccbd5]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:15 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6 Jul 13 20:45:15 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:15 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6" returned: 0 in 0.355s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:15 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6 Jul 13 20:45:15 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:15 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6" returned: 0 in 0.266s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-quobyte-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6" released by "delete_volume" :: held 0.665s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Created reservations ['f5aa85e9-1c7c-42bb-bff3-14ff27f50fd5', 'f8edd43a-3935-4d08-9407-89e2f6cc8c82', '53f05612-0c0d-4c69-b673-cca4bbda4575', '1657c60c-32cd-406c-999a-f4ea142f8766'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Flow 'volume_create_manager' (b0654bd0-9ec7-469b-93b7-b49f83a31d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b42a596-c239-49dd-855c-338b169a6746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b42a596-c239-49dd-855c-338b169a6746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-854928274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3683f036-3b68-49b6-9a8e-7fd83d042884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c1ae2021e046adaf82a503bb145cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:16Z,use_quota=True,user_id='e32b44d82126403c8d90e5e1ffc935dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8277f98a-c2e8-4361-81a3-e91dbdb41c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8277f98a-c2e8-4361-81a3-e91dbdb41c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38310d1a-a94a-4485-837a-a2bc29418187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38310d1a-a94a-4485-837a-a2bc29418187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3683f036-3b68-49b6-9a8e-7fd83d042884', 'volume_name': 'volume-3683f036-3b68-49b6-9a8e-7fd83d042884', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf65e57-17e7-49b5-8646-5dec5e341ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf65e57-17e7-49b5-8646-5dec5e341ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d8e978-357c-47e9-ad1d-6cfcf2b401ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:16 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Volume 3683f036-3b68-49b6-9a8e-7fd83d042884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3683f036-3b68-49b6-9a8e-7fd83d042884', 'volume_size': 1} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-854928274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3683f036-3b68-49b6-9a8e-7fd83d042884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c1ae2021e046adaf82a503bb145cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:16Z,use_quota=True,user_id='e32b44d82126403c8d90e5e1ffc935dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Creating volume 3683f036-3b68-49b6-9a8e-7fd83d042884 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:45:16 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3683f036-3b68-49b6-9a8e-7fd83d042884 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:16 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3683f036-3b68-49b6-9a8e-7fd83d042884 1073741824 Jul 13 20:45:16 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:16 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:45:16 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "cinder-e7603d28-d4f7-42f5-84f9-0d259aa93579-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-e7603d28-d4f7-42f5-84f9-0d259aa93579-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "cinder-quobyte-e7603d28-d4f7-42f5-84f9-0d259aa93579" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:16 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.283s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-quobyte-e7603d28-d4f7-42f5-84f9-0d259aa93579" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Deleted volume successfully. Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5f96b8-72b3-4fe1-930a-0916b9e1cf84]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7603d28-d4f7-42f5-84f9-0d259aa93579 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-526c2371-fbc2-47bd-ad86-25cdc530c48c tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-f1c8e836-35b6-4d1e-bf8c-7df9c60f42d6-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:16 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3683f036-3b68-49b6-9a8e-7fd83d042884 1073741824" returned: 0 in 0.466s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:16 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7603d28-d4f7-42f5-84f9-0d259aa93579 Jul 13 20:45:16 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3683f036-3b68-49b6-9a8e-7fd83d042884 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:16 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3683f036-3b68-49b6-9a8e-7fd83d042884 Jul 13 20:45:16 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:16 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3683f036-3b68-49b6-9a8e-7fd83d042884" returned: 0 in 0.241s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:16 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d8e978-357c-47e9-ad1d-6cfcf2b401ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3683f036-3b68-49b6-9a8e-7fd83d042884', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a166ed9f-7e83-4c1e-b0c8-d72d9dedaf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7603d28-d4f7-42f5-84f9-0d259aa93579" returned: 0 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7603d28-d4f7-42f5-84f9-0d259aa93579 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:16 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Volume volume-3683f036-3b68-49b6-9a8e-7fd83d042884 (3683f036-3b68-49b6-9a8e-7fd83d042884): created successfully Jul 13 20:45:16 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7603d28-d4f7-42f5-84f9-0d259aa93579 Jul 13 20:45:16 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a166ed9f-7e83-4c1e-b0c8-d72d9dedaf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Flow 'volume_create_manager' (b0654bd0-9ec7-469b-93b7-b49f83a31d4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-26e1dec9-5c72-4be0-8fbd-7ac7d7817aa7 tempest-VolumesTransfersTest-647283128 None] Created volume successfully. Jul 13 20:45:17 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e7603d28-d4f7-42f5-84f9-0d259aa93579" returned: 0 in 0.259s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-quobyte-e7603d28-d4f7-42f5-84f9-0d259aa93579" released by "delete_volume" :: held 0.691s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:17 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Created reservations ['4f2de1eb-f5ba-4dd0-b0d9-677c03e98dda', '88bbaa9a-9c50-4ea3-a290-ef03d4a2b855', '938acb0b-b04e-473c-8097-7bd84070dfc8', '5aa04565-099f-4d0c-be9e-292c04414477'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:45:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:17 devstack sudo[103035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:45:17 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:17 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.263s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:17 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:45:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Deleted volume successfully. Jul 13 20:45:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "cinder-a8500642-15a9-45e6-b640-518e902c207b-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d7b078d3-5142-4f60-83e8-25b8a71eb2db tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-e7603d28-d4f7-42f5-84f9-0d259aa93579-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-a8500642-15a9-45e6-b640-518e902c207b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "cinder-quobyte-a8500642-15a9-45e6-b640-518e902c207b" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5db172b8-2149-4419-b953-6455b7875f40 tempest-VolumesTransfersTest-1141807235 None] Transfer volume completed successfully. Jul 13 20:45:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-quobyte-a8500642-15a9-45e6-b640-518e902c207b" acquired by "delete_volume" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:17 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b27b8c-dca7-42f3-87df-062a2e824a97]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a8500642-15a9-45e6-b640-518e902c207b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:17 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a8500642-15a9-45e6-b640-518e902c207b Jul 13 20:45:17 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:18 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a8500642-15a9-45e6-b640-518e902c207b" returned: 0 in 0.368s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a8500642-15a9-45e6-b640-518e902c207b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:18 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a8500642-15a9-45e6-b640-518e902c207b Jul 13 20:45:18 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] Acquiring lock "cinder-3683f036-3b68-49b6-9a8e-7fd83d042884-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] Lock "cinder-3683f036-3b68-49b6-9a8e-7fd83d042884-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] Acquiring lock "cinder-quobyte-3683f036-3b68-49b6-9a8e-7fd83d042884" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] Lock "cinder-quobyte-3683f036-3b68-49b6-9a8e-7fd83d042884" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefcd063-6284-4117-973b-462a4ada7fe9]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3683f036-3b68-49b6-9a8e-7fd83d042884 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:18 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-a8500642-15a9-45e6-b640-518e902c207b" returned: 0 in 0.275s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-quobyte-a8500642-15a9-45e6-b640-518e902c207b" released by "delete_volume" :: held 0.686s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:18 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3683f036-3b68-49b6-9a8e-7fd83d042884 Jul 13 20:45:18 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Created reservations ['5bb65af7-b02b-4f31-88c7-de9d5dde0e9a', 'f776c772-c855-4e8c-97c5-5c874841186a', 'b5a1df59-e5f9-4e0f-950f-0c15d7dfbb95', '78b03294-379a-4282-9ab0-8a279517f911'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:18 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:45:18 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:18 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3683f036-3b68-49b6-9a8e-7fd83d042884" returned: 0 in 0.353s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3683f036-3b68-49b6-9a8e-7fd83d042884 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:18 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3683f036-3b68-49b6-9a8e-7fd83d042884 Jul 13 20:45:18 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:18 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.258s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:45:18 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Deleted volume successfully. Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-97f4c4f0-d082-46e8-8018-008ff396b6d1 tempest-CreateVolumesFromSourceVolumeTest-776911765 None] Lock "cinder-a8500642-15a9-45e6-b640-518e902c207b-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:18 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:45:18 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:18 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3683f036-3b68-49b6-9a8e-7fd83d042884" returned: 0 in 0.266s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] Lock "cinder-quobyte-3683f036-3b68-49b6-9a8e-7fd83d042884" released by "delete_volume" :: held 0.661s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:18 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] Created reservations ['c124770f-9c45-491d-8ce0-74e926645c87', 'd95df689-ec1b-4b53-8c3d-faf724a5cefc', 'bdd36868-4515-4cb7-a803-fef3ba59a86b', '4612abc2-bdcc-4b1f-bc02-f95e554c6196'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:19 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:45:19 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:19 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.284s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:45:19 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.274s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:45:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] Deleted volume successfully. Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2745fb15-2c82-4a95-84a0-6fc5682aee7c tempest-VolumesTransfersTest-326102490 None] Lock "cinder-3683f036-3b68-49b6-9a8e-7fd83d042884-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Flow 'volume_create_manager' (9b83087a-ac93-4803-96cd-621638bfe019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f07270-10a1-472a-b4e1-338a847e8057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f07270-10a1-472a-b4e1-338a847e8057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1624608912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c1ae2021e046adaf82a503bb145cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:20Z,use_quota=True,user_id='e32b44d82126403c8d90e5e1ffc935dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78009221-7bbb-4091-87be-972686b086bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78009221-7bbb-4091-87be-972686b086bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8cb54e-9eed-4e23-9921-0b8aa2a2c612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8cb54e-9eed-4e23-9921-0b8aa2a2c612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd', 'volume_name': 'volume-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe7b314-5dbe-4ff4-b7c7-b5f611f102a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe7b314-5dbe-4ff4-b7c7-b5f611f102a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c12da989-3be3-44cb-ac1d-d5859859d0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:19 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Volume dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd', 'volume_size': 1} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1624608912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c1ae2021e046adaf82a503bb145cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:20Z,use_quota=True,user_id='e32b44d82126403c8d90e5e1ffc935dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Creating volume dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:45:20 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:45:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:20 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd 1073741824 Jul 13 20:45:20 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:20 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd 1073741824" returned: 0 in 0.446s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:20 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd Jul 13 20:45:20 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:20 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd" returned: 0 in 0.250s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:45:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c12da989-3be3-44cb-ac1d-d5859859d0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e0a04b-b9ec-43f1-a261-f43d71ed1297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:20 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Volume volume-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd (dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd): created successfully Jul 13 20:45:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e0a04b-b9ec-43f1-a261-f43d71ed1297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Flow 'volume_create_manager' (9b83087a-ac93-4803-96cd-621638bfe019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d93b1874-f140-4ca7-a882-6afd911e1a9d tempest-VolumesTransfersTest-647283128 None] Created volume successfully. Jul 13 20:45:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] Acquiring lock "cinder-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] Lock "cinder-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] Acquiring lock "cinder-quobyte-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] Lock "cinder-quobyte-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a2d9ba-a57f-45ee-a934-3acab2cad731]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:21 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd Jul 13 20:45:21 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:21 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd" returned: 0 in 0.359s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:21 devstack sudo[103079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd Jul 13 20:45:21 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:21 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd" returned: 0 in 0.245s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] Lock "cinder-quobyte-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd" released by "delete_volume" :: held 0.649s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:21 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] Created reservations ['950d8d6f-83f7-42a4-b1e0-8a7796ed868e', '14e44cce-c21c-4c16-a4b7-2befc4620af8', '946335e0-10c7-462b-9f46-b77e60d820a5', '7ca879dc-8907-4eb7-b26a-aad8fd151c34'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:45:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:22 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:45:22 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:22 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.261s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:22 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:45:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] Deleted volume successfully. Jul 13 20:45:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bfc3746c-257d-4df6-b02e-762d1d17b2cf tempest-VolumesTransfersTest-326102490 None] Lock "cinder-dcb7aa99-88c6-4948-9d1a-2ee0343c8ffd-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:24 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:45:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Flow 'volume_create_manager' (5be10adf-fe7a-4f8f-a543-e37e902a00f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbecb5ff-7511-43ba-95ec-1a8c966945e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbecb5ff-7511-43ba-95ec-1a8c966945e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c712c214-e153-46a1-aad5-a76f98822a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77576611bcb840808abe901ebf3b8599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:24Z,use_quota=True,user_id='2fb2ac8116324188b7022d02991abaf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bae5001-0391-49fb-93d7-f364438fdc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bae5001-0391-49fb-93d7-f364438fdc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9bfa7cf-3409-4f4e-991e-8925f89e3922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:24 devstack cinder-volume[87269]: DEBUG cinder.image.glance [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Creating Keystone auth plugin from conf {{(pid=87269) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 13 20:45:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9bfa7cf-3409-4f4e-991e-8925f89e3922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c712c214-e153-46a1-aad5-a76f98822a9b', 'volume_name': 'volume-c712c214-e153-46a1-aad5-a76f98822a9b', 'volume_size': 1, 'image_id': '18de5d49-fdfa-4d8f-98b4-405beaaeccd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/18de5d49-fdfa-4d8f-98b4-405beaaeccd1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3777799fd92695d443c8d59e5585e5b7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '77576611bcb840808abe901ebf3b8599', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04bb637318d04767f82cde73ddbc630752a19b5fbeaa3f05958d90ee0426c9eccfbcf630c24250f0d84d6c04ca00f16d68a4986c43b593474bdf2373367601c2', 'id': '18de5d49-fdfa-4d8f-98b4-405beaaeccd1', 'created_at': datetime.datetime(2026, 7, 13, 18, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/18de5d49-fdfa-4d8f-98b4-405beaaeccd1/file', 'properties': {}}, 'image_service': }' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004fc21a-09bc-453d-bae2-96a7f784b0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004fc21a-09bc-453d-bae2-96a7f784b0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61352f0-d374-4fbc-808e-571a8eb79525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:24 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Volume c712c214-e153-46a1-aad5-a76f98822a9b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c712c214-e153-46a1-aad5-a76f98822a9b', 'volume_size': 1, 'image_id': '18de5d49-fdfa-4d8f-98b4-405beaaeccd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/18de5d49-fdfa-4d8f-98b4-405beaaeccd1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3777799fd92695d443c8d59e5585e5b7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '77576611bcb840808abe901ebf3b8599', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04bb637318d04767f82cde73ddbc630752a19b5fbeaa3f05958d90ee0426c9eccfbcf630c24250f0d84d6c04ca00f16d68a4986c43b593474bdf2373367601c2', 'id': '18de5d49-fdfa-4d8f-98b4-405beaaeccd1', 'created_at': datetime.datetime(2026, 7, 13, 18, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/18de5d49-fdfa-4d8f-98b4-405beaaeccd1/file', 'properties': {}}, 'image_service': } Jul 13 20:45:24 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Trying to clone c712c214-e153-46a1-aad5-a76f98822a9b from image 18de5d49-fdfa-4d8f-98b4-405beaaeccd1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/18de5d49-fdfa-4d8f-98b4-405beaaeccd1', 'metadata': {}}]). {{(pid=87269) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 13 20:45:25 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 13 20:45:25 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Image download 0.00 MB at 0.00 MB/s Jul 13 20:45:25 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c618c3-ffbf-4eae-aa42-73fceea3c045]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:25 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD Jul 13 20:45:25 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:25 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:25 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD Jul 13 20:45:25 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:25 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:45:25 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Temporary image 18de5d49-fdfa-4d8f-98b4-405beaaeccd1 is fetched for user 2fb2ac8116324188b7022d02991abaf1. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 13 20:45:25 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba00aeb-6d75-4593-b750-d297e4e36bda]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:25 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD Jul 13 20:45:25 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:26 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:26 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD Jul 13 20:45:26 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:26 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:45:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c712c214-e153-46a1-aad5-a76f98822a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77576611bcb840808abe901ebf3b8599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:24Z,use_quota=True,user_id='2fb2ac8116324188b7022d02991abaf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:45:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Creating volume c712c214-e153-46a1-aad5-a76f98822a9b {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:45:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:45:26 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:45:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:26 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b 1073741824 Jul 13 20:45:26 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:27 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b 1073741824" returned: 0 in 0.452s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:27 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b Jul 13 20:45:27 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:27 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b" returned: 0 in 0.260s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Attempting download of 18de5d49-fdfa-4d8f-98b4-405beaaeccd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/18de5d49-fdfa-4d8f-98b4-405beaaeccd1', 'metadata': {}}])) to volume c712c214-e153-46a1-aad5-a76f98822a9b. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce76b9b-771d-4b51-9abc-e1f3bf9e3a73]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_0e9yuvrc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:27 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_0e9yuvrc Jul 13 20:45:27 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:27 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_0e9yuvrc" returned: 0 in 0.353s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_0e9yuvrc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Flow 'volume_create_manager' (b048bd62-8fdb-4e8e-9c79-c187f2c4bb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cef0015-3dc3-4756-9ff5-680282d03266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cef0015-3dc3-4756-9ff5-680282d03266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-917366477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2caebf8d-0df3-46e3-be44-465029f15364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f435b0ee9de645ccbca9f52cc79975ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:28Z,use_quota=True,user_id='3cc790f71f2a4921922e76cb8c026ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0058e766-7869-4bf5-962a-39f1b508a74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0058e766-7869-4bf5-962a-39f1b508a74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce261e2-b8e1-4187-8cdd-b4f41aa4a20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce261e2-b8e1-4187-8cdd-b4f41aa4a20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2caebf8d-0df3-46e3-be44-465029f15364', 'volume_name': 'volume-2caebf8d-0df3-46e3-be44-465029f15364', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b955e0-f8d9-4413-bab8-0f0904f6a187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:27 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_0e9yuvrc Jul 13 20:45:27 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b955e0-f8d9-4413-bab8-0f0904f6a187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0907486-7e12-43ee-9da7-d4520919135b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:27 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Volume 2caebf8d-0df3-46e3-be44-465029f15364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2caebf8d-0df3-46e3-be44-465029f15364', 'volume_size': 1} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-917366477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2caebf8d-0df3-46e3-be44-465029f15364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f435b0ee9de645ccbca9f52cc79975ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:28Z,use_quota=True,user_id='3cc790f71f2a4921922e76cb8c026ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Creating volume 2caebf8d-0df3-46e3-be44-465029f15364 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:45:27 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:45:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2caebf8d-0df3-46e3-be44-465029f15364 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:27 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2caebf8d-0df3-46e3-be44-465029f15364 1073741824 Jul 13 20:45:27 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:28 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_0e9yuvrc" returned: 1 in 0.330s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_0e9yuvrc' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:45:28 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdc5f77-e671-442c-9575-4e9ea7fe3d30]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:28 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD Jul 13 20:45:28 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:28 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2caebf8d-0df3-46e3-be44-465029f15364 1073741824" returned: 0 in 0.423s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2caebf8d-0df3-46e3-be44-465029f15364 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:28 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2caebf8d-0df3-46e3-be44-465029f15364 Jul 13 20:45:28 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:28 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:28 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD Jul 13 20:45:28 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:28 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2caebf8d-0df3-46e3-be44-465029f15364" returned: 0 in 0.265s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:45:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0907486-7e12-43ee-9da7-d4520919135b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2caebf8d-0df3-46e3-be44-465029f15364', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f79cba4-9fa3-42ef-b888-fa6f09bc845f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:28 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Volume volume-2caebf8d-0df3-46e3-be44-465029f15364 (2caebf8d-0df3-46e3-be44-465029f15364): created successfully Jul 13 20:45:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f79cba4-9fa3-42ef-b888-fa6f09bc845f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Flow 'volume_create_manager' (b048bd62-8fdb-4e8e-9c79-c187f2c4bb5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d2cede54-9b9d-49b9-8ba6-8bc3c70f0a96 tempest-VolumesNegativeTest-2051609493 None] Created volume successfully. Jul 13 20:45:28 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD" returned: 1 in 0.335s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:45:28 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] 18de5d49-fdfa-4d8f-98b4-405beaaeccd1 was raw, converting to raw {{(pid=87269) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 13 20:45:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:28 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b Jul 13 20:45:28 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:29 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b" returned: 0 in 0.350s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:29 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_18de5d49-fdfa-4d8f-98b4-405beaaeccd1_k08utg9edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:45:29 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Converted 0.00 MB image at 0.00 MB/s Jul 13 20:45:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:29 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b 1G Jul 13 20:45:29 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:29 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b 1G" returned: 0 in 0.307s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:29 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faf6cee-d9bc-4f56-9794-6ba2c8451bba]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:29 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b Jul 13 20:45:29 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:29 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b" returned: 0 in 0.377s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:30 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b Jul 13 20:45:30 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:30 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b" returned: 1 in 0.392s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:45:30 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Downloaded image 18de5d49-fdfa-4d8f-98b4-405beaaeccd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/18de5d49-fdfa-4d8f-98b4-405beaaeccd1', 'metadata': {}}])) to volume c712c214-e153-46a1-aad5-a76f98822a9b successfully. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 13 20:45:30 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Temporary image 18de5d49-fdfa-4d8f-98b4-405beaaeccd1 for user 2fb2ac8116324188b7022d02991abaf1 is deleted. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 13 20:45:30 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Marking volume c712c214-e153-46a1-aad5-a76f98822a9b as bootable. {{(pid=87269) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 13 20:45:30 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Copying metadata from image 18de5d49-fdfa-4d8f-98b4-405beaaeccd1 to c712c214-e153-46a1-aad5-a76f98822a9b. {{(pid=87269) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 13 20:45:30 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Creating volume glance metadata for volume c712c214-e153-46a1-aad5-a76f98822a9b backed by image 18de5d49-fdfa-4d8f-98b4-405beaaeccd1 with: {'image_id': '18de5d49-fdfa-4d8f-98b4-405beaaeccd1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3777799fd92695d443c8d59e5585e5b7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87269) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 13 20:45:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61352f0-d374-4fbc-808e-571a8eb79525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c712c214-e153-46a1-aad5-a76f98822a9b', 'volume_size': 1, 'image_id': '18de5d49-fdfa-4d8f-98b4-405beaaeccd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/18de5d49-fdfa-4d8f-98b4-405beaaeccd1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3777799fd92695d443c8d59e5585e5b7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '77576611bcb840808abe901ebf3b8599', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04bb637318d04767f82cde73ddbc630752a19b5fbeaa3f05958d90ee0426c9eccfbcf630c24250f0d84d6c04ca00f16d68a4986c43b593474bdf2373367601c2', 'id': '18de5d49-fdfa-4d8f-98b4-405beaaeccd1', 'created_at': datetime.datetime(2026, 7, 13, 18, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/18de5d49-fdfa-4d8f-98b4-405beaaeccd1/file', 'properties': {}}, 'image_service': }' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3a40eb-57ef-47a8-868e-ab0437db7dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:30 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Volume volume-c712c214-e153-46a1-aad5-a76f98822a9b (c712c214-e153-46a1-aad5-a76f98822a9b): created successfully Jul 13 20:45:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3a40eb-57ef-47a8-868e-ab0437db7dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Flow 'volume_create_manager' (5be10adf-fe7a-4f8f-a543-e37e902a00f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c9a44e45-19e0-498d-a708-3be960b8dad0 tempest-VolumeImageDependencyTests-1457318550 None] Created volume successfully. Jul 13 20:45:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] Acquiring lock "cinder-c712c214-e153-46a1-aad5-a76f98822a9b-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] Lock "cinder-c712c214-e153-46a1-aad5-a76f98822a9b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] Acquiring lock "cinder-quobyte-c712c214-e153-46a1-aad5-a76f98822a9b" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] Lock "cinder-quobyte-c712c214-e153-46a1-aad5-a76f98822a9b" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:30 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b17a7be-7789-4c3c-9029-d564789ce580]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:31 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b Jul 13 20:45:31 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:31 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b" returned: 0 in 0.419s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:31 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b Jul 13 20:45:31 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:31 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b" returned: 1 in 0.399s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:45:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:31 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b Jul 13 20:45:31 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:31 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c712c214-e153-46a1-aad5-a76f98822a9b" returned: 0 in 0.284s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] Lock "cinder-quobyte-c712c214-e153-46a1-aad5-a76f98822a9b" released by "delete_volume" :: held 1.187s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:32 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] Created reservations ['967cf068-93f2-4aab-9892-273706ad01d8', 'fdc28d69-77d6-472b-abf9-407b6d0a7072', '92cd7e58-a722-4300-8aca-67cb9fcc469f', '1e498738-350f-4f30-8774-b1c280ad3300'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:45:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:32 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:45:32 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:32 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.299s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:32 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:45:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] Deleted volume successfully. Jul 13 20:45:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f8a3e5e8-c201-4b22-9f75-e14fff841f9b tempest-VolumeImageDependencyTests-1457318550 None] Lock "cinder-c712c214-e153-46a1-aad5-a76f98822a9b-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] Acquiring lock "cinder-2caebf8d-0df3-46e3-be44-465029f15364-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] Lock "cinder-2caebf8d-0df3-46e3-be44-465029f15364-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] Acquiring lock "cinder-quobyte-2caebf8d-0df3-46e3-be44-465029f15364" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] Lock "cinder-quobyte-2caebf8d-0df3-46e3-be44-465029f15364" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a44d441-c607-4908-a764-2e7dbe581db9]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2caebf8d-0df3-46e3-be44-465029f15364 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:45 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2caebf8d-0df3-46e3-be44-465029f15364 Jul 13 20:45:45 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:46 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2caebf8d-0df3-46e3-be44-465029f15364" returned: 0 in 0.344s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2caebf8d-0df3-46e3-be44-465029f15364 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:46 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2caebf8d-0df3-46e3-be44-465029f15364 Jul 13 20:45:46 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:46 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2caebf8d-0df3-46e3-be44-465029f15364" returned: 0 in 0.235s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] Lock "cinder-quobyte-2caebf8d-0df3-46e3-be44-465029f15364" released by "delete_volume" :: held 0.615s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:46 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] Created reservations ['8ca6b5fb-6d68-432d-a0dc-f708d74ea25a', 'fba1ea14-142a-48db-a8c2-2bcd9de518e1', '97feb789-fead-49a0-b5ae-56e3c6b28881', '609ebad8-50da-4f3f-aa5b-5be3d6e84b53'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:45:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:46 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:45:46 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:46 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.238s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:46 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:45:46 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] Deleted volume successfully. Jul 13 20:45:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-413a6958-7cce-4bcd-99b8-28c01e73cb47 tempest-VolumesNegativeTest-2051609493 None] Lock "cinder-2caebf8d-0df3-46e3-be44-465029f15364-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Flow 'volume_create_manager' (d06428af-1ff3-424a-ad00-ccae225b9aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc329e43-affd-4c6d-8013-e063cc7b10fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc329e43-affd-4c6d-8013-e063cc7b10fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-631507983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9f217c-d00b-4c23-9032-ac1461a26754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e918fb5b13a4d23a5e251b0a5937555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:49Z,use_quota=True,user_id='5c284bafbbe84501878072f55e74abd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fefaef4e-625d-4819-ba09-96631f0e4a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fefaef4e-625d-4819-ba09-96631f0e4a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7054df-dc36-4959-87fb-a4058979e382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7054df-dc36-4959-87fb-a4058979e382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc9f217c-d00b-4c23-9032-ac1461a26754', 'volume_name': 'volume-dc9f217c-d00b-4c23-9032-ac1461a26754', 'volume_size': 2}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439b22d8-68da-4435-99df-ddf63ef6dc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439b22d8-68da-4435-99df-ddf63ef6dc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8560584b-ee36-47ce-823f-ae087b59251e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:49 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Volume dc9f217c-d00b-4c23-9032-ac1461a26754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc9f217c-d00b-4c23-9032-ac1461a26754', 'volume_size': 2} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-631507983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9f217c-d00b-4c23-9032-ac1461a26754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e918fb5b13a4d23a5e251b0a5937555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:45:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:45:49Z,use_quota=True,user_id='5c284bafbbe84501878072f55e74abd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Creating volume dc9f217c-d00b-4c23-9032-ac1461a26754 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:45:49 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754 2147483648 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:49 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754 2147483648 Jul 13 20:45:49 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:49 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754 2147483648" returned: 0 in 0.450s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:49 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754 Jul 13 20:45:49 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:50 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754" returned: 0 in 0.287s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:45:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8560584b-ee36-47ce-823f-ae087b59251e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc9f217c-d00b-4c23-9032-ac1461a26754', 'volume_size': 2}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56798c5a-7d61-4c86-9a12-8532e3b69007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:45:50 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Volume volume-dc9f217c-d00b-4c23-9032-ac1461a26754 (dc9f217c-d00b-4c23-9032-ac1461a26754): created successfully Jul 13 20:45:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56798c5a-7d61-4c86-9a12-8532e3b69007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:45:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Flow 'volume_create_manager' (d06428af-1ff3-424a-ad00-ccae225b9aff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:45:50 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-95102407-d50c-482b-a735-7e80b04a66d4 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Created volume successfully. Jul 13 20:45:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0935820e-a9dc-40dd-8f69-14e9d53f0f35 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0935820e-a9dc-40dd-8f69-14e9d53f0f35 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0935820e-a9dc-40dd-8f69-14e9d53f0f35 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Creating offline snapshot 542d5401-9db2-462a-ac77-8ccf225330c1 of volume dc9f217c-d00b-4c23-9032-ac1461a26754 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:45:50 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[916f774a-6fd5-4c1f-8b23-52229cb3b601]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0935820e-a9dc-40dd-8f69-14e9d53f0f35 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:50 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754 Jul 13 20:45:50 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:50 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0935820e-a9dc-40dd-8f69-14e9d53f0f35 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754" returned: 0 in 0.345s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0935820e-a9dc-40dd-8f69-14e9d53f0f35 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1 2G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:50 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1 2G Jul 13 20:45:50 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:51 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0935820e-a9dc-40dd-8f69-14e9d53f0f35 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1 2G" returned: 0 in 0.377s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0935820e-a9dc-40dd-8f69-14e9d53f0f35 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc9f217c-d00b-4c23-9032-ac1461a26754 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:51 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc9f217c-d00b-4c23-9032-ac1461a26754 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1 Jul 13 20:45:51 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:51 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0935820e-a9dc-40dd-8f69-14e9d53f0f35 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc9f217c-d00b-4c23-9032-ac1461a26754 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1" returned: 0 in 0.284s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:51 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-0935820e-a9dc-40dd-8f69-14e9d53f0f35 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1 is being set with open permissions: ugo+rw Jul 13 20:45:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0935820e-a9dc-40dd-8f69-14e9d53f0f35 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:51 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1 Jul 13 20:45:51 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:51 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0935820e-a9dc-40dd-8f69-14e9d53f0f35 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1" returned: 0 in 0.230s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0935820e-a9dc-40dd-8f69-14e9d53f0f35 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:51 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.info Jul 13 20:45:51 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:52 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0935820e-a9dc-40dd-8f69-14e9d53f0f35 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.info" returned: 0 in 0.238s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:52 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-0935820e-a9dc-40dd-8f69-14e9d53f0f35 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.info is being set with open permissions: ugo+rw Jul 13 20:45:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0935820e-a9dc-40dd-8f69-14e9d53f0f35 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:52 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.info Jul 13 20:45:52 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:52 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0935820e-a9dc-40dd-8f69-14e9d53f0f35 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.info" returned: 0 in 0.255s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0935820e-a9dc-40dd-8f69-14e9d53f0f35 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.805s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:52 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0935820e-a9dc-40dd-8f69-14e9d53f0f35 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Create snapshot completed successfully Jul 13 20:45:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Acquiring lock "cinder-542d5401-9db2-462a-ac77-8ccf225330c1-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Lock "cinder-542d5401-9db2-462a-ac77-8ccf225330c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Acquiring lock "cinder-quobyte-dc9f217c-d00b-4c23-9032-ac1461a26754" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Lock "cinder-quobyte-dc9f217c-d00b-4c23-9032-ac1461a26754" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Acquiring lock "cinder-quobyte-542d5401-9db2-462a-ac77-8ccf225330c1" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Lock "cinder-quobyte-542d5401-9db2-462a-ac77-8ccf225330c1" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Deleting offline snapshot 542d5401-9db2-462a-ac77-8ccf225330c1 of volume dc9f217c-d00b-4c23-9032-ac1461a26754 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:45:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] snapshot_file for this snap is: volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:45:52 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[52af96ea-d135-43e5-844b-2f6e0c3c5c6e]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:52 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1 Jul 13 20:45:52 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:53 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1" returned: 0 in 0.348s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc9f217c-d00b-4c23-9032-ac1461a26754(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:45:53 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d38afb-4ba3-4993-b169-a7a1db095af8]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:53 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754 Jul 13 20:45:53 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:53 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754" returned: 0 in 0.350s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:53 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1 Jul 13 20:45:53 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:53 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1" returned: 0 in 0.337s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:53 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1 Jul 13 20:45:53 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:54 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754.542d5401-9db2-462a-ac77-8ccf225330c1" returned: 0 in 0.235s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Lock "cinder-quobyte-542d5401-9db2-462a-ac77-8ccf225330c1" released by "_delete_snapshot" :: held 1.372s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Lock "cinder-quobyte-dc9f217c-d00b-4c23-9032-ac1461a26754" released by "delete_snapshot" :: held 1.392s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:54 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Created reservations ['f229520b-fb0e-4695-932f-e510fa685bcf', 'a39f429a-e389-456a-87f7-ee3a03cea8a6', '2828c9d0-3587-4f76-9855-dd540fa54de7', '25bb77ed-60f9-4a04-93b2-8b236685af17'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:45:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Delete snapshot completed successfully. Jul 13 20:45:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7997da48-4d14-4794-9f47-b4967a75f4e6 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Lock "cinder-542d5401-9db2-462a-ac77-8ccf225330c1-delete_snapshot" released by "delete_snapshot" :: held 1.521s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Acquiring lock "cinder-dc9f217c-d00b-4c23-9032-ac1461a26754-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Lock "cinder-dc9f217c-d00b-4c23-9032-ac1461a26754-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Acquiring lock "cinder-quobyte-dc9f217c-d00b-4c23-9032-ac1461a26754" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:45:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Lock "cinder-quobyte-dc9f217c-d00b-4c23-9032-ac1461a26754" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:45:54 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cc20c6-5f0c-4993-9ce3-ea0f44a308ba]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:45:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:55 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754 Jul 13 20:45:55 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:55 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754" returned: 0 in 0.356s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:55 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754 Jul 13 20:45:55 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:55 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc9f217c-d00b-4c23-9032-ac1461a26754" returned: 0 in 0.236s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Lock "cinder-quobyte-dc9f217c-d00b-4c23-9032-ac1461a26754" released by "delete_volume" :: held 0.648s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:45:55 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Created reservations ['6fd17f17-e590-4238-a479-de0ab1b64acf', 'df64f843-a00b-4bf6-a0d4-70e374d808fc', '6946f0df-37df-4f5d-9a67-17878366761b', '28005346-3da4-4a7c-ae99-9f9b41ca1253'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:45:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:45:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:45:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:45:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:45:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:45:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:45:55 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:45:55 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:45:55 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Jul 13 20:45:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.237s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:45:55 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:45:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Deleted volume successfully. Jul 13 20:45:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-01cc2900-aa14-4700-843c-090d396f4513 tempest-VolumesSnapshotNegativeTestJSON-1793074044 None] Lock "cinder-dc9f217c-d00b-4c23-9032-ac1461a26754-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:46:05 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=121,cinder:SELECT=81,cinder:INSERT=37,cinder:DELETE=7 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:46:05 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:INSERT=31,cinder:UPDATE=138,cinder:SELECT=103,cinder:DELETE=14 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:46:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:46:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:46:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:46:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:46:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:46:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:46:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:46:18 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:46:18 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:46:19 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Jul 13 20:46:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.312s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:46:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:46:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:46:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:46:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Flow 'volume_create_manager' (a1c623b9-7934-4d4e-99b3-b0f2bc619b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e0fc00-d12d-4cd1-887c-b37c2fe215cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e0fc00-d12d-4cd1-887c-b37c2fe215cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1372073510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91bd5c85-825c-4392-80c0-a3d83e625008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72dab725bc114050bc36cefa1f5af1e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:46:45Z,use_quota=True,user_id='e7b0fc3379ea4223abf225befdf93a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f76148-79cb-4982-9e53-08be61006ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f76148-79cb-4982-9e53-08be61006ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a5ec4b-f9dc-4267-a63a-5e622253b527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a5ec4b-f9dc-4267-a63a-5e622253b527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91bd5c85-825c-4392-80c0-a3d83e625008', 'volume_name': 'volume-91bd5c85-825c-4392-80c0-a3d83e625008', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b9fe00-f9f1-4940-8899-6b6438970e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b9fe00-f9f1-4940-8899-6b6438970e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5c116f-6e17-42a8-9cbf-c2d61d63b49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:46:45 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Volume 91bd5c85-825c-4392-80c0-a3d83e625008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91bd5c85-825c-4392-80c0-a3d83e625008', 'volume_size': 1} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1372073510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91bd5c85-825c-4392-80c0-a3d83e625008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72dab725bc114050bc36cefa1f5af1e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:46:45Z,use_quota=True,user_id='e7b0fc3379ea4223abf225befdf93a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Creating volume 91bd5c85-825c-4392-80c0-a3d83e625008 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:46:45 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:46:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-91bd5c85-825c-4392-80c0-a3d83e625008 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:46:45 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-91bd5c85-825c-4392-80c0-a3d83e625008 1073741824 Jul 13 20:46:45 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:46:46 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Jul 13 20:46:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-91bd5c85-825c-4392-80c0-a3d83e625008 1073741824" returned: 0 in 0.427s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:46:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-91bd5c85-825c-4392-80c0-a3d83e625008 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:46:46 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-91bd5c85-825c-4392-80c0-a3d83e625008 Jul 13 20:46:46 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:46:46 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Jul 13 20:46:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-91bd5c85-825c-4392-80c0-a3d83e625008" returned: 0 in 0.252s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:46:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:46:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:46:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5c116f-6e17-42a8-9cbf-c2d61d63b49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91bd5c85-825c-4392-80c0-a3d83e625008', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:46:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d59d2c5-4ba4-47a0-b5cf-fcc28d4545ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:46:46 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Volume volume-91bd5c85-825c-4392-80c0-a3d83e625008 (91bd5c85-825c-4392-80c0-a3d83e625008): created successfully Jul 13 20:46:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d59d2c5-4ba4-47a0-b5cf-fcc28d4545ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:46:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Flow 'volume_create_manager' (a1c623b9-7934-4d4e-99b3-b0f2bc619b72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:46:46 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-98dd19b3-8528-43fa-98be-cf1676bf6bed tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Created volume successfully. Jul 13 20:46:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-de932cc7-e6e3-4a7a-b45b-fde9e6e04d01 req-bbe0773a-2499-464f-bc79-d073620c6c88 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:46:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-de932cc7-e6e3-4a7a-b45b-fde9e6e04d01 req-bbe0773a-2499-464f-bc79-d073620c6c88 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:46:47 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[295442b0-499d-451e-a4e0-9754ef8e9cad]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:46:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-de932cc7-e6e3-4a7a-b45b-fde9e6e04d01 req-bbe0773a-2499-464f-bc79-d073620c6c88 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-91bd5c85-825c-4392-80c0-a3d83e625008 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:46:47 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-91bd5c85-825c-4392-80c0-a3d83e625008 Jul 13 20:46:47 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:46:47 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Jul 13 20:46:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-de932cc7-e6e3-4a7a-b45b-fde9e6e04d01 req-bbe0773a-2499-464f-bc79-d073620c6c88 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-91bd5c85-825c-4392-80c0-a3d83e625008" returned: 0 in 0.374s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:46:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-de932cc7-e6e3-4a7a-b45b-fde9e6e04d01 req-bbe0773a-2499-464f-bc79-d073620c6c88 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.391s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:46:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-de932cc7-e6e3-4a7a-b45b-fde9e6e04d01 req-bbe0773a-2499-464f-bc79-d073620c6c88 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-91bd5c85-825c-4392-80c0-a3d83e625008', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8202a09-e194-4183-a425-9277d5304d2c', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:46:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-de932cc7-e6e3-4a7a-b45b-fde9e6e04d01 req-bbe0773a-2499-464f-bc79-d073620c6c88 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] attachment_update completed successfully. Jul 13 20:46:50 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-ed3b83e9-a258-4673-84fe-34a41c6a7ff6 req-46412b06-5748-4f13-9562-4a920128564f tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Terminate volume connection completed successfully. Jul 13 20:46:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-ed3b83e9-a258-4673-84fe-34a41c6a7ff6 req-46412b06-5748-4f13-9562-4a920128564f tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Deleting attachment e8202a09-e194-4183-a425-9277d5304d2c. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:46:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Acquiring lock "cinder-91bd5c85-825c-4392-80c0-a3d83e625008-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:46:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Lock "cinder-91bd5c85-825c-4392-80c0-a3d83e625008-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:46:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Acquiring lock "cinder-quobyte-91bd5c85-825c-4392-80c0-a3d83e625008" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:46:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Lock "cinder-quobyte-91bd5c85-825c-4392-80c0-a3d83e625008" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:46:51 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6db4418-1e11-4a7a-a5c6-2f9dcc5f2012]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:46:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-91bd5c85-825c-4392-80c0-a3d83e625008 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:46:51 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-91bd5c85-825c-4392-80c0-a3d83e625008 Jul 13 20:46:51 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:46:51 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Jul 13 20:46:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-91bd5c85-825c-4392-80c0-a3d83e625008" returned: 0 in 0.355s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:46:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-91bd5c85-825c-4392-80c0-a3d83e625008 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:46:51 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-91bd5c85-825c-4392-80c0-a3d83e625008 Jul 13 20:46:51 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:46:52 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Jul 13 20:46:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-91bd5c85-825c-4392-80c0-a3d83e625008" returned: 0 in 0.240s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:46:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Lock "cinder-quobyte-91bd5c85-825c-4392-80c0-a3d83e625008" released by "delete_volume" :: held 0.632s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:46:52 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Created reservations ['75930bd7-ca79-4559-9129-70479c64840e', '934a3a44-15e1-4f70-82ae-fd095f80c503', '584a5db5-f6df-4fca-9361-c602b1b44ac4', '69977a21-2cfe-48e4-a43a-edc0d45dc7e0'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:46:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:46:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:46:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:46:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:46:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:46:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:46:52 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:46:52 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:46:52 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Jul 13 20:46:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.237s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:46:52 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:46:52 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Deleted volume successfully. Jul 13 20:46:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2b220fbe-7894-4a54-bf9d-1ff82f7d3107 tempest-TestServerVolumeAttachScenarioOldVersion-2082089991 None] Lock "cinder-91bd5c85-825c-4392-80c0-a3d83e625008-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:47:02 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=14,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:47:02 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=13,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:47:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:47:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:47:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:47:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:47:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:47:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:47:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:47:18 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:47:18 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:47:19 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Jul 13 20:47:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.262s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:47:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:47:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:47:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:47:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Flow 'volume_create_manager' (d6d7e03b-e9b2-4cdc-bd3c-0594bd61dfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c06b04-edb4-47da-9ec9-823f63112d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c06b04-edb4-47da-9ec9-823f63112d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-18099868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=809bce3e-494d-4bf2-b21e-578164a667cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c25ea923a44297909e1f6b41cf8d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:47:22Z,use_quota=True,user_id='236ce3680de24e44af3086a4494686df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c831ef-d009-49c1-a599-a4a9a8c8cf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c831ef-d009-49c1-a599-a4a9a8c8cf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4eaca82-3bd8-41ec-8513-d8dcb2359859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4eaca82-3bd8-41ec-8513-d8dcb2359859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '809bce3e-494d-4bf2-b21e-578164a667cc', 'volume_name': 'volume-809bce3e-494d-4bf2-b21e-578164a667cc', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792b1335-e928-4fbd-9736-7e63b3ae812f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792b1335-e928-4fbd-9736-7e63b3ae812f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb59c159-9f69-4721-b8b1-9b2feeb054fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:47:22 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Volume 809bce3e-494d-4bf2-b21e-578164a667cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-809bce3e-494d-4bf2-b21e-578164a667cc', 'volume_size': 1} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-18099868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=809bce3e-494d-4bf2-b21e-578164a667cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c25ea923a44297909e1f6b41cf8d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:47:22Z,use_quota=True,user_id='236ce3680de24e44af3086a4494686df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Creating volume 809bce3e-494d-4bf2-b21e-578164a667cc {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:47:22 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-809bce3e-494d-4bf2-b21e-578164a667cc 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:47:22 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-809bce3e-494d-4bf2-b21e-578164a667cc 1073741824 Jul 13 20:47:22 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Flow 'volume_create_manager' (b23ce822-be87-42cd-b1a7-f5a28e86b91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb469ace-5baa-45ad-bac6-9908093417b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb469ace-5baa-45ad-bac6-9908093417b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-416666061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c25ea923a44297909e1f6b41cf8d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:47:22Z,use_quota=True,user_id='236ce3680de24e44af3086a4494686df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdefac2-0497-4a96-81cf-f1af0d367b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdefac2-0497-4a96-81cf-f1af0d367b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad985c8-f33a-480e-b1a5-33eb9255d8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad985c8-f33a-480e-b1a5-33eb9255d8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a', 'volume_name': 'volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba835fbe-e887-426a-9ad3-8ffd6747275d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba835fbe-e887-426a-9ad3-8ffd6747275d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8927d05d-9cb9-4443-ba9e-182d36514d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:47:22 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Volume 0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a', 'volume_size': 1} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:47:22 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-809bce3e-494d-4bf2-b21e-578164a667cc 1073741824" returned: 0 in 0.518s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-809bce3e-494d-4bf2-b21e-578164a667cc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:47:22 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-809bce3e-494d-4bf2-b21e-578164a667cc Jul 13 20:47:22 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:47:22 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-809bce3e-494d-4bf2-b21e-578164a667cc" returned: 0 in 0.263s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.444s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-416666061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c25ea923a44297909e1f6b41cf8d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:47:22Z,use_quota=True,user_id='236ce3680de24e44af3086a4494686df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Creating volume 0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:47:22 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb59c159-9f69-4721-b8b1-9b2feeb054fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-809bce3e-494d-4bf2-b21e-578164a667cc', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:47:22 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a 1073741824 Jul 13 20:47:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362b4b09-29d6-4b72-b635-7ee8899935f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:47:22 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:47:23 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Volume volume-809bce3e-494d-4bf2-b21e-578164a667cc (809bce3e-494d-4bf2-b21e-578164a667cc): created successfully Jul 13 20:47:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362b4b09-29d6-4b72-b635-7ee8899935f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:47:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Flow 'volume_create_manager' (d6d7e03b-e9b2-4cdc-bd3c-0594bd61dfe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:47:23 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-86ece3b5-f0a6-439a-a271-3fce0e8ec089 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Created volume successfully. Jul 13 20:47:23 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Jul 13 20:47:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a 1073741824" returned: 0 in 0.474s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:47:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:47:23 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a Jul 13 20:47:23 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:47:23 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Jul 13 20:47:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a" returned: 0 in 0.244s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:47:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:47:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:47:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8927d05d-9cb9-4443-ba9e-182d36514d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:47:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3555791d-117d-40a8-b111-54238eb1ffba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:47:23 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Volume volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a (0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a): created successfully Jul 13 20:47:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3555791d-117d-40a8-b111-54238eb1ffba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:47:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Flow 'volume_create_manager' (b23ce822-be87-42cd-b1a7-f5a28e86b91a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:47:23 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-aaafc280-abea-4f4c-aa43-9c161a9b0c59 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Created volume successfully. Jul 13 20:47:33 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:47:33 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=7,cinder:SELECT=3,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:47:47 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:47:47 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:47:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-f2d1b079-83c8-4e67-8388-e9475b0f143c req-9e291012-ab15-4cfb-b392-d103c3080c28 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:47:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-f2d1b079-83c8-4e67-8388-e9475b0f143c req-9e291012-ab15-4cfb-b392-d103c3080c28 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:47:53 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cb7457-ed05-4103-b207-57a8886d8b06]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:47:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-f2d1b079-83c8-4e67-8388-e9475b0f143c req-9e291012-ab15-4cfb-b392-d103c3080c28 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-809bce3e-494d-4bf2-b21e-578164a667cc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:47:53 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-809bce3e-494d-4bf2-b21e-578164a667cc Jul 13 20:47:53 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:47:53 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Jul 13 20:47:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-f2d1b079-83c8-4e67-8388-e9475b0f143c req-9e291012-ab15-4cfb-b392-d103c3080c28 tempest-TestServerVolumeAttachmentScenario-1600332571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-809bce3e-494d-4bf2-b21e-578164a667cc" returned: 0 in 0.349s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:47:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-f2d1b079-83c8-4e67-8388-e9475b0f143c req-9e291012-ab15-4cfb-b392-d103c3080c28 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.369s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:47:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-f2d1b079-83c8-4e67-8388-e9475b0f143c req-9e291012-ab15-4cfb-b392-d103c3080c28 tempest-TestServerVolumeAttachmentScenario-1600332571 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-809bce3e-494d-4bf2-b21e-578164a667cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '330b544b-dc85-4437-a19e-30579d7ce9d0', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:47:53 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-f2d1b079-83c8-4e67-8388-e9475b0f143c req-9e291012-ab15-4cfb-b392-d103c3080c28 tempest-TestServerVolumeAttachmentScenario-1600332571 None] attachment_update completed successfully. Jul 13 20:47:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-28127d54-2bec-481c-9f35-114c858054f4 req-11193714-9c36-4c1b-ad74-c45b06f1774f tempest-TestServerVolumeAttachmentScenario-1600332571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:47:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-28127d54-2bec-481c-9f35-114c858054f4 req-11193714-9c36-4c1b-ad74-c45b06f1774f tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:47:57 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec33f674-8dad-412c-8900-cfddd86fa3a7]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:47:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-28127d54-2bec-481c-9f35-114c858054f4 req-11193714-9c36-4c1b-ad74-c45b06f1774f tempest-TestServerVolumeAttachmentScenario-1600332571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:47:57 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a Jul 13 20:47:57 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:47:57 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Jul 13 20:47:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-28127d54-2bec-481c-9f35-114c858054f4 req-11193714-9c36-4c1b-ad74-c45b06f1774f tempest-TestServerVolumeAttachmentScenario-1600332571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a" returned: 0 in 0.347s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:47:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-28127d54-2bec-481c-9f35-114c858054f4 req-11193714-9c36-4c1b-ad74-c45b06f1774f tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.365s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:47:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-28127d54-2bec-481c-9f35-114c858054f4 req-11193714-9c36-4c1b-ad74-c45b06f1774f tempest-TestServerVolumeAttachmentScenario-1600332571 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507', 'name': 'volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28958ed5-d4c9-429d-89bc-a629a792fef1', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 20:47:57 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-28127d54-2bec-481c-9f35-114c858054f4 req-11193714-9c36-4c1b-ad74-c45b06f1774f tempest-TestServerVolumeAttachmentScenario-1600332571 None] attachment_update completed successfully. Jul 13 20:47:59 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-e1720433-aa7d-4470-8bba-79ade8516528 req-af9910f1-b48c-47cd-a8c1-d57cb5b8bbcf tempest-TestServerVolumeAttachmentScenario-1600332571 None] Terminate volume connection completed successfully. Jul 13 20:47:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-e1720433-aa7d-4470-8bba-79ade8516528 req-af9910f1-b48c-47cd-a8c1-d57cb5b8bbcf tempest-TestServerVolumeAttachmentScenario-1600332571 None] Deleting attachment 28958ed5-d4c9-429d-89bc-a629a792fef1. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:48:01 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-bd74a84a-0ecb-45ba-bf2c-38275339db0b req-8e2b9f00-4cc8-4d06-bc67-36267cd8809f tempest-TestServerVolumeAttachmentScenario-1600332571 None] Terminate volume connection completed successfully. Jul 13 20:48:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-bd74a84a-0ecb-45ba-bf2c-38275339db0b req-8e2b9f00-4cc8-4d06-bc67-36267cd8809f tempest-TestServerVolumeAttachmentScenario-1600332571 None] Deleting attachment 330b544b-dc85-4437-a19e-30579d7ce9d0. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 20:48:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] Acquiring lock "cinder-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:48:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "cinder-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:48:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] Acquiring lock "cinder-quobyte-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:48:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "cinder-quobyte-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a" acquired by "delete_volume" :: waited 0.012s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:48:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c187a95a-f013-44bb-99a9-0ce0fe85c4ab]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:48:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:05 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a Jul 13 20:48:05 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:06 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a" returned: 0 in 0.353s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:06 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a Jul 13 20:48:06 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:06 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a" returned: 0 in 0.238s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "cinder-quobyte-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a" released by "delete_volume" :: held 0.630s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:48:06 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] Created reservations ['6cef1289-e3f7-41d3-8318-bf259bda6c2f', 'd8a95011-1936-427a-9d3b-1a77b15af94d', '5ee803bf-5f15-4329-b7e4-29f6b00c6a29', 'b5450bfd-047d-4f01-969c-902c5f2564e2'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:48:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:48:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:48:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:48:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:48:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:48:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:06 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:48:06 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:06 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.232s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:06 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:48:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] Deleted volume successfully. Jul 13 20:48:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c52f0884-4b59-4cea-afe9-ad4c532a2bdb tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "cinder-0798b4a4-4d2c-4aaa-ae63-e63aadd9e24a-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:48:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] Acquiring lock "cinder-809bce3e-494d-4bf2-b21e-578164a667cc-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:48:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "cinder-809bce3e-494d-4bf2-b21e-578164a667cc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:48:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] Acquiring lock "cinder-quobyte-809bce3e-494d-4bf2-b21e-578164a667cc" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:48:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "cinder-quobyte-809bce3e-494d-4bf2-b21e-578164a667cc" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:48:07 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb14e43-f9db-4d20-bd8c-7de1f1a9a73b]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:48:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-809bce3e-494d-4bf2-b21e-578164a667cc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:07 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-809bce3e-494d-4bf2-b21e-578164a667cc Jul 13 20:48:07 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:07 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-809bce3e-494d-4bf2-b21e-578164a667cc" returned: 0 in 0.341s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-809bce3e-494d-4bf2-b21e-578164a667cc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:07 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-809bce3e-494d-4bf2-b21e-578164a667cc Jul 13 20:48:07 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:07 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-809bce3e-494d-4bf2-b21e-578164a667cc" returned: 0 in 0.234s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "cinder-quobyte-809bce3e-494d-4bf2-b21e-578164a667cc" released by "delete_volume" :: held 0.612s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:48:07 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] Created reservations ['577895de-448a-472c-83c5-dcd044759e9b', 'aec54a56-e7fb-4ef3-910e-fe5ea79f7e27', 'ef24b7f4-b4e0-489c-a178-cb4ab272f0da', '9ea4490c-9fd5-4a33-9761-c7a7bf9061ee'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:48:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:48:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:48:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:48:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:48:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:48:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:07 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:48:07 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:07 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.252s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:07 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:48:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] Deleted volume successfully. Jul 13 20:48:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-69e34cec-1b8b-4818-a8f5-bf07ef788e3c tempest-TestServerVolumeAttachmentScenario-1600332571 None] Lock "cinder-809bce3e-494d-4bf2-b21e-578164a667cc-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:48:17 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=18,cinder:UPDATE=16,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:48:18 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=28,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:48:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:48:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:48:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:48:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:48:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:48:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:48:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:18 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:48:18 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:19 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.252s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:48:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:48:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:48:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:48:19 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:48:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Flow 'volume_create_manager' (f78d46b4-f8c6-4e4d-aca7-9c6141ecc554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:48:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79aeef28-47b0-4ce8-9801-3d0624752192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:48:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79aeef28-47b0-4ce8-9801-3d0624752192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94b86e3-d78e-4266-b924-66589b67c004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc0eacf8d1a462eb7cb21473e2756cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:48:20Z,use_quota=True,user_id='d3d44f0f13484c7abeb275612063e2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62de46b9-43f9-4df8-92bc-585a9df11835),volume_type_id=62de46b9-43f9-4df8-92bc-585a9df11835)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:48:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a37805-7d0a-40e6-9ef3-a46660efdc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:48:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a37805-7d0a-40e6-9ef3-a46660efdc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:48:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ff01ca-27ec-4d56-b81a-a132c98ed90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:48:20 devstack cinder-volume[87269]: DEBUG cinder.image.glance [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Creating Keystone auth plugin from conf {{(pid=87269) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 13 20:48:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ff01ca-27ec-4d56-b81a-a132c98ed90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd94b86e3-d78e-4266-b924-66589b67c004', 'volume_name': 'volume-d94b86e3-d78e-4266-b924-66589b67c004', 'volume_size': 1, 'image_id': '751a193d-199e-496d-9852-e06f82cd64fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/751a193d-199e-496d-9852-e06f82cd64fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8da0e2a00dcf454fa57e4852c8070265', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6dc0eacf8d1a462eb7cb21473e2756cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ebbec23406434b483044ff2c6eae07a2cd21cf5be3a90ba63b36b849418d09542f2b3bd5fb6d86e6baa65d3ff7961e9919f5ee23259549e89f7499a1643961d1', 'id': '751a193d-199e-496d-9852-e06f82cd64fe', 'created_at': datetime.datetime(2026, 7, 13, 18, 48, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 48, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/751a193d-199e-496d-9852-e06f82cd64fe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:48:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b200f4c-1010-4496-beb2-0d8c875b6863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:48:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b200f4c-1010-4496-beb2-0d8c875b6863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:48:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1515367-b182-4fe8-8f46-bf31ad030bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:48:20 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Volume d94b86e3-d78e-4266-b924-66589b67c004: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d94b86e3-d78e-4266-b924-66589b67c004', 'volume_size': 1, 'image_id': '751a193d-199e-496d-9852-e06f82cd64fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/751a193d-199e-496d-9852-e06f82cd64fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8da0e2a00dcf454fa57e4852c8070265', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6dc0eacf8d1a462eb7cb21473e2756cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ebbec23406434b483044ff2c6eae07a2cd21cf5be3a90ba63b36b849418d09542f2b3bd5fb6d86e6baa65d3ff7961e9919f5ee23259549e89f7499a1643961d1', 'id': '751a193d-199e-496d-9852-e06f82cd64fe', 'created_at': datetime.datetime(2026, 7, 13, 18, 48, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 48, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/751a193d-199e-496d-9852-e06f82cd64fe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 13 20:48:20 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Trying to clone d94b86e3-d78e-4266-b924-66589b67c004 from image 751a193d-199e-496d-9852-e06f82cd64fe at location (None, [{'url': 'file:///opt/stack/data/glance/images/751a193d-199e-496d-9852-e06f82cd64fe', 'metadata': {}}]). {{(pid=87269) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 13 20:48:20 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 13 20:48:20 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Image download 0.00 MB at 0.00 MB/s Jul 13 20:48:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9714b936-9685-4dfc-831c-0ba7088f573d]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:48:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:20 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD Jul 13 20:48:20 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:20 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:20 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD Jul 13 20:48:20 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:21 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD" returned: 1 in 0.313s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Temporary image 751a193d-199e-496d-9852-e06f82cd64fe is fetched for user d3d44f0f13484c7abeb275612063e2ad. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[268d3790-48dc-4a8d-97dc-ef193f938480]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:21 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD Jul 13 20:48:21 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:21 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:21 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD Jul 13 20:48:21 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:21 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD" returned: 1 in 0.314s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94b86e3-d78e-4266-b924-66589b67c004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc0eacf8d1a462eb7cb21473e2756cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:48:20Z,use_quota=True,user_id='d3d44f0f13484c7abeb275612063e2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62de46b9-43f9-4df8-92bc-585a9df11835),volume_type_id=62de46b9-43f9-4df8-92bc-585a9df11835)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Creating volume d94b86e3-d78e-4266-b924-66589b67c004 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:48:21 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:48:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:21 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 1073741824 Jul 13 20:48:21 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:22 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 1073741824" returned: 0 in 0.422s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:22 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 Jul 13 20:48:22 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:22 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004" returned: 0 in 0.241s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:48:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:48:22 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Attempting download of 751a193d-199e-496d-9852-e06f82cd64fe ((None, [{'url': 'file:///opt/stack/data/glance/images/751a193d-199e-496d-9852-e06f82cd64fe', 'metadata': {}}])) to volume d94b86e3-d78e-4266-b924-66589b67c004. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 13 20:48:22 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[06370bfa-bdba-4c60-b127-0d1eca45db17]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:48:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_751a193d-199e-496d-9852-e06f82cd64fe_l17b8wqg {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:22 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_751a193d-199e-496d-9852-e06f82cd64fe_l17b8wqg Jul 13 20:48:22 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:22 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_751a193d-199e-496d-9852-e06f82cd64fe_l17b8wqg" returned: 0 in 0.324s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_751a193d-199e-496d-9852-e06f82cd64fe_l17b8wqg {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:22 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_751a193d-199e-496d-9852-e06f82cd64fe_l17b8wqg Jul 13 20:48:22 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:23 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_751a193d-199e-496d-9852-e06f82cd64fe_l17b8wqg" returned: 1 in 0.319s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_751a193d-199e-496d-9852-e06f82cd64fe_l17b8wqg' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:48:23 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21361cf-3376-4a4e-bb60-0d16ee1702e8]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:48:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:23 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD Jul 13 20:48:23 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:23 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD" returned: 0 in 0.312s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:23 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD Jul 13 20:48:23 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:23 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD" returned: 1 in 0.319s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:48:23 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] 751a193d-199e-496d-9852-e06f82cd64fe was raw, converting to raw {{(pid=87269) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 13 20:48:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:23 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 Jul 13 20:48:23 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:24 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004" returned: 0 in 0.319s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:24 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_751a193d-199e-496d-9852-e06f82cd64fe_xr0rhl4vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:48:24 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Converted 0.00 MB image at 0.00 MB/s Jul 13 20:48:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:24 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 1G Jul 13 20:48:24 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:24 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 1G" returned: 0 in 0.273s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5336f9-1e8f-4cbd-a075-730007bc6dc7]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:48:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:24 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 Jul 13 20:48:24 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:24 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004" returned: 0 in 0.348s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:24 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 Jul 13 20:48:24 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:25 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004" returned: 1 in 0.334s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:48:25 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Downloaded image 751a193d-199e-496d-9852-e06f82cd64fe ((None, [{'url': 'file:///opt/stack/data/glance/images/751a193d-199e-496d-9852-e06f82cd64fe', 'metadata': {}}])) to volume d94b86e3-d78e-4266-b924-66589b67c004 successfully. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 13 20:48:25 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Temporary image 751a193d-199e-496d-9852-e06f82cd64fe for user d3d44f0f13484c7abeb275612063e2ad is deleted. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 13 20:48:25 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Marking volume d94b86e3-d78e-4266-b924-66589b67c004 as bootable. {{(pid=87269) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 13 20:48:25 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Copying metadata from image 751a193d-199e-496d-9852-e06f82cd64fe to d94b86e3-d78e-4266-b924-66589b67c004. {{(pid=87269) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 13 20:48:25 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Creating volume glance metadata for volume d94b86e3-d78e-4266-b924-66589b67c004 backed by image 751a193d-199e-496d-9852-e06f82cd64fe with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '751a193d-199e-496d-9852-e06f82cd64fe', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8da0e2a00dcf454fa57e4852c8070265', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87269) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 13 20:48:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1515367-b182-4fe8-8f46-bf31ad030bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d94b86e3-d78e-4266-b924-66589b67c004', 'volume_size': 1, 'image_id': '751a193d-199e-496d-9852-e06f82cd64fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/751a193d-199e-496d-9852-e06f82cd64fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8da0e2a00dcf454fa57e4852c8070265', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6dc0eacf8d1a462eb7cb21473e2756cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ebbec23406434b483044ff2c6eae07a2cd21cf5be3a90ba63b36b849418d09542f2b3bd5fb6d86e6baa65d3ff7961e9919f5ee23259549e89f7499a1643961d1', 'id': '751a193d-199e-496d-9852-e06f82cd64fe', 'created_at': datetime.datetime(2026, 7, 13, 18, 48, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 48, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/751a193d-199e-496d-9852-e06f82cd64fe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:48:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7aaa16-f5e4-44bd-976e-4bb9fa625d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:48:25 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Volume volume-d94b86e3-d78e-4266-b924-66589b67c004 (d94b86e3-d78e-4266-b924-66589b67c004): created successfully Jul 13 20:48:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7aaa16-f5e4-44bd-976e-4bb9fa625d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:48:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Flow 'volume_create_manager' (f78d46b4-f8c6-4e4d-aca7-9c6141ecc554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:48:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2e8c5df9-8ec8-4d5c-977b-59d4951ecde3 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Created volume successfully. Jul 13 20:48:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Acquiring lock "cinder-d94b86e3-d78e-4266-b924-66589b67c004-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:48:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Lock "cinder-d94b86e3-d78e-4266-b924-66589b67c004-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:48:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Acquiring lock "cinder-quobyte-d94b86e3-d78e-4266-b924-66589b67c004" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:48:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Lock "cinder-quobyte-d94b86e3-d78e-4266-b924-66589b67c004" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:48:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[de70f752-977a-4b59-9a0c-0c20d4366fed]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:48:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:26 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 Jul 13 20:48:26 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:26 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004" returned: 0 in 0.334s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:26 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 Jul 13 20:48:26 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:27 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004" returned: 1 in 0.330s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:48:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:27 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004 Jul 13 20:48:27 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:27 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-d94b86e3-d78e-4266-b924-66589b67c004" returned: 0 in 0.236s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Lock "cinder-quobyte-d94b86e3-d78e-4266-b924-66589b67c004" released by "delete_volume" :: held 0.960s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:48:27 devstack cinder-volume[87269]: WARNING cinder.quota [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:48:27 devstack cinder-volume[87269]: WARNING cinder.quota [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 13 20:48:27 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Created reservations ['8d7685fa-2718-441c-b223-a58d3f437b2e', 'f582768e-45d5-4c3b-afdb-f3ed17b77ec3', 'b021407b-4a97-4501-b6ca-bad166d33901', '7e2dd5d7-a845-4ed8-8e43-37b375b08a44'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:48:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:48:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:48:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:48:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:48:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:48:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:27 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:48:27 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:27 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.238s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:27 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:48:27 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Deleted volume successfully. Jul 13 20:48:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce17893a-9afd-485e-b4fd-2dd4d8e4e682 tempest-VolumeAndVolumeTypeFromImageTest-1310157917 None] Lock "cinder-d94b86e3-d78e-4266-b924-66589b67c004-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Flow 'volume_create_manager' (708b4edd-0683-4b03-b45b-49254fd621ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (314e2b0a-7e8b-4445-903b-bfae6928ce22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (314e2b0a-7e8b-4445-903b-bfae6928ce22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1260604182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f97551d-e049-4f43-966a-ee340b985994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad4266c9befa42cba854954147c57426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:48:33Z,use_quota=True,user_id='bf737723d9d048c29119911dbe500042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1e6648-1c96-4f2e-aec7-2d6bb94a1f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1e6648-1c96-4f2e-aec7-2d6bb94a1f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (102fd938-2e75-4bd2-90da-3678e0e97919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (102fd938-2e75-4bd2-90da-3678e0e97919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f97551d-e049-4f43-966a-ee340b985994', 'volume_name': 'volume-0f97551d-e049-4f43-966a-ee340b985994', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73d72d1-5685-49a7-984b-3447541261c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73d72d1-5685-49a7-984b-3447541261c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4935ecc2-c487-4ec2-8086-a2c276ff4ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:48:32 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Volume 0f97551d-e049-4f43-966a-ee340b985994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f97551d-e049-4f43-966a-ee340b985994', 'volume_size': 1} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1260604182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f97551d-e049-4f43-966a-ee340b985994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad4266c9befa42cba854954147c57426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:48:33Z,use_quota=True,user_id='bf737723d9d048c29119911dbe500042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Creating volume 0f97551d-e049-4f43-966a-ee340b985994 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:48:32 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:48:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:32 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 1073741824 Jul 13 20:48:32 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:33 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 1073741824" returned: 0 in 0.410s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:33 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 Jul 13 20:48:33 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:33 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994" returned: 0 in 0.257s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:48:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:48:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4935ecc2-c487-4ec2-8086-a2c276ff4ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f97551d-e049-4f43-966a-ee340b985994', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:48:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c871a92-b154-4333-ae07-a0acecbaa17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:48:33 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Volume volume-0f97551d-e049-4f43-966a-ee340b985994 (0f97551d-e049-4f43-966a-ee340b985994): created successfully Jul 13 20:48:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c871a92-b154-4333-ae07-a0acecbaa17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:48:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Flow 'volume_create_manager' (708b4edd-0683-4b03-b45b-49254fd621ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:48:33 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a2e0d283-73bc-4b7b-afc2-0b79492a595c tempest-VolumeDependencyTests-1648079611 None] Created volume successfully. Jul 13 20:48:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-74ef2281-d957-47a6-bfcc-1e2261a3357b tempest-VolumeDependencyTests-1648079611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:48:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-74ef2281-d957-47a6-bfcc-1e2261a3357b tempest-VolumeDependencyTests-1648079611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:48:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-74ef2281-d957-47a6-bfcc-1e2261a3357b tempest-VolumeDependencyTests-1648079611 None] Creating offline snapshot 808c6ea3-3eed-48ad-8628-6d14967e8e1c of volume 0f97551d-e049-4f43-966a-ee340b985994 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:48:33 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a879112-7c50-4b28-8b89-cd2999cd8a5c]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:48:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-74ef2281-d957-47a6-bfcc-1e2261a3357b tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:33 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 Jul 13 20:48:33 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:34 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-74ef2281-d957-47a6-bfcc-1e2261a3357b tempest-VolumeDependencyTests-1648079611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994" returned: 0 in 0.349s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-74ef2281-d957-47a6-bfcc-1e2261a3357b tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:34 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c 1G Jul 13 20:48:34 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:34 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-74ef2281-d957-47a6-bfcc-1e2261a3357b tempest-VolumeDependencyTests-1648079611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c 1G" returned: 0 in 0.419s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-74ef2281-d957-47a6-bfcc-1e2261a3357b tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f97551d-e049-4f43-966a-ee340b985994 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:34 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f97551d-e049-4f43-966a-ee340b985994 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c Jul 13 20:48:34 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:34 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-74ef2281-d957-47a6-bfcc-1e2261a3357b tempest-VolumeDependencyTests-1648079611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f97551d-e049-4f43-966a-ee340b985994 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c" returned: 0 in 0.280s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:34 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-74ef2281-d957-47a6-bfcc-1e2261a3357b tempest-VolumeDependencyTests-1648079611 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c is being set with open permissions: ugo+rw Jul 13 20:48:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-74ef2281-d957-47a6-bfcc-1e2261a3357b tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:34 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c Jul 13 20:48:34 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:35 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-74ef2281-d957-47a6-bfcc-1e2261a3357b tempest-VolumeDependencyTests-1648079611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c" returned: 0 in 0.233s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-74ef2281-d957-47a6-bfcc-1e2261a3357b tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:35 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.info Jul 13 20:48:35 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:35 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-74ef2281-d957-47a6-bfcc-1e2261a3357b tempest-VolumeDependencyTests-1648079611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.info" returned: 0 in 0.239s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:35 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-74ef2281-d957-47a6-bfcc-1e2261a3357b tempest-VolumeDependencyTests-1648079611 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.info is being set with open permissions: ugo+rw Jul 13 20:48:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-74ef2281-d957-47a6-bfcc-1e2261a3357b tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:35 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.info Jul 13 20:48:35 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:35 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-74ef2281-d957-47a6-bfcc-1e2261a3357b tempest-VolumeDependencyTests-1648079611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.info" returned: 0 in 0.232s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-74ef2281-d957-47a6-bfcc-1e2261a3357b tempest-VolumeDependencyTests-1648079611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:48:35 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-74ef2281-d957-47a6-bfcc-1e2261a3357b tempest-VolumeDependencyTests-1648079611 None] Create snapshot completed successfully Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Flow 'volume_create_manager' (8e309c99-11a4-4c90-867b-243ab67b269b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56ca5d5-b63d-4aa1-9f25-0204bfea3b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56ca5d5-b63d-4aa1-9f25-0204bfea3b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1758159461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726a744c-f63b-487f-9312-d3ba71efd6fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad4266c9befa42cba854954147c57426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=808c6ea3-3eed-48ad-8628-6d14967e8e1c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:48:36Z,use_quota=True,user_id='bf737723d9d048c29119911dbe500042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2d132a-e356-45bd-9916-a3db2e795137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2d132a-e356-45bd-9916-a3db2e795137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d784b295-0d47-4d36-b1ba-9613af7b8f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d784b295-0d47-4d36-b1ba-9613af7b8f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '726a744c-f63b-487f-9312-d3ba71efd6fb', 'volume_name': 'volume-726a744c-f63b-487f-9312-d3ba71efd6fb', 'volume_size': 1, 'snapshot_id': '808c6ea3-3eed-48ad-8628-6d14967e8e1c'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2d59df-4d21-44aa-af5f-77af77b8528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2d59df-4d21-44aa-af5f-77af77b8528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb2c7a2-8b37-4bac-aea6-783c1780653e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:48:36 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Volume 726a744c-f63b-487f-9312-d3ba71efd6fb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-726a744c-f63b-487f-9312-d3ba71efd6fb', 'volume_size': 1, 'snapshot_id': '808c6ea3-3eed-48ad-8628-6d14967e8e1c'} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Acquiring lock "cinder-quobyte-808c6ea3-3eed-48ad-8628-6d14967e8e1c-726a744c-f63b-487f-9312-d3ba71efd6fb" by "_create_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Lock "cinder-quobyte-808c6ea3-3eed-48ad-8628-6d14967e8e1c-726a744c-f63b-487f-9312-d3ba71efd6fb" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Creating volume 726a744c-f63b-487f-9312-d3ba71efd6fb from snapshot 808c6ea3-3eed-48ad-8628-6d14967e8e1c {{(pid=87269) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Acquiring lock "cinder-quobyte-726a744c-f63b-487f-9312-d3ba71efd6fb" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Lock "cinder-quobyte-726a744c-f63b-487f-9312-d3ba71efd6fb" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] snapshot: 808c6ea3-3eed-48ad-8628-6d14967e8e1c, volume: 726a744c-f63b-487f-9312-d3ba71efd6fb, {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9370e1-2288-4b66-a670-316c4cb7aacf]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:36 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c Jul 13 20:48:36 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:36 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c" returned: 0 in 0.347s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f97551d-e049-4f43-966a-ee340b985994(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3f0050-86d1-41a3-9ab5-3a627c8621b8]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:48:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:37 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 Jul 13 20:48:37 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:37 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994" returned: 0 in 0.349s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:37 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Path /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-726a744c-f63b-487f-9312-d3ba71efd6fb not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 20:48:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-726a744c-f63b-487f-9312-d3ba71efd6fb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:37 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-726a744c-f63b-487f-9312-d3ba71efd6fb Jul 13 20:48:37 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:41 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-726a744c-f63b-487f-9312-d3ba71efd6fb" returned: 0 in 4.025s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:41 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9324312-e778-41d7-b3f4-13694fe30c71]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:48:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:41 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 Jul 13 20:48:41 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:41 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994" returned: 0 in 0.513s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:41 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994, size 1024.00 MB, duration 4.03 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-726a744c-f63b-487f-9312-d3ba71efd6fb {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:48:41 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Converted 1024.00 MB image at 254.35 MB/s Jul 13 20:48:41 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-726a744c-f63b-487f-9312-d3ba71efd6fb is being set with open permissions: ugo+rw Jul 13 20:48:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-726a744c-f63b-487f-9312-d3ba71efd6fb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:41 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-726a744c-f63b-487f-9312-d3ba71efd6fb Jul 13 20:48:41 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:42 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-726a744c-f63b-487f-9312-d3ba71efd6fb" returned: 0 in 0.244s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Lock "cinder-quobyte-726a744c-f63b-487f-9312-d3ba71efd6fb" released by "_copy_volume_from_snapshot" :: held 5.565s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:48:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Lock "cinder-quobyte-808c6ea3-3eed-48ad-8628-6d14967e8e1c-726a744c-f63b-487f-9312-d3ba71efd6fb" released by "_create_volume_from_snapshot" :: held 5.590s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:48:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.604s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:48:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb2c7a2-8b37-4bac-aea6-783c1780653e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726a744c-f63b-487f-9312-d3ba71efd6fb', 'volume_size': 1, 'snapshot_id': '808c6ea3-3eed-48ad-8628-6d14967e8e1c'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:48:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff30df69-2cb2-4812-85de-daa09043c144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:48:42 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Volume volume-726a744c-f63b-487f-9312-d3ba71efd6fb (726a744c-f63b-487f-9312-d3ba71efd6fb): created successfully Jul 13 20:48:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff30df69-2cb2-4812-85de-daa09043c144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:48:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Flow 'volume_create_manager' (8e309c99-11a4-4c90-867b-243ab67b269b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:48:42 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-19218c19-4e9a-44c8-8685-a438f3764d2b tempest-VolumeDependencyTests-1648079611 None] Created volume successfully. Jul 13 20:48:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] Acquiring lock "cinder-808c6ea3-3eed-48ad-8628-6d14967e8e1c-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:48:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] Lock "cinder-808c6ea3-3eed-48ad-8628-6d14967e8e1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:48:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] Acquiring lock "cinder-quobyte-0f97551d-e049-4f43-966a-ee340b985994" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:48:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] Lock "cinder-quobyte-0f97551d-e049-4f43-966a-ee340b985994" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:48:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] Acquiring lock "cinder-quobyte-808c6ea3-3eed-48ad-8628-6d14967e8e1c" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:48:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] Lock "cinder-quobyte-808c6ea3-3eed-48ad-8628-6d14967e8e1c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:48:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] Deleting offline snapshot 808c6ea3-3eed-48ad-8628-6d14967e8e1c of volume 0f97551d-e049-4f43-966a-ee340b985994 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:48:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] snapshot_file for this snap is: volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:48:42 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c29362-e064-46ae-8a2e-d64672bf94b2]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:48:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:43 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c Jul 13 20:48:43 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:43 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c" returned: 0 in 0.353s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f97551d-e049-4f43-966a-ee340b985994(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:48:43 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e341ba-8ac1-4474-a014-0f8c2c323197]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:48:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:43 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 Jul 13 20:48:43 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:43 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994" returned: 0 in 0.348s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:43 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c Jul 13 20:48:43 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:44 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c" returned: 0 in 0.337s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:44 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c Jul 13 20:48:44 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:44 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994.808c6ea3-3eed-48ad-8628-6d14967e8e1c" returned: 0 in 0.244s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] Lock "cinder-quobyte-808c6ea3-3eed-48ad-8628-6d14967e8e1c" released by "_delete_snapshot" :: held 1.379s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:48:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] Lock "cinder-quobyte-0f97551d-e049-4f43-966a-ee340b985994" released by "delete_snapshot" :: held 1.400s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:48:44 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] Created reservations ['d8b823e5-8d8d-4b70-b7e0-6d47ab2b5894', '42ac2e73-ca73-428e-868f-2470070f48eb', '10d1ac9b-3186-4c16-9c8a-906a26abffed', '11424a5f-58f9-4c31-9309-ea2e06a77b1a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:48:44 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] Delete snapshot completed successfully. Jul 13 20:48:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f7f36d1-3bf1-44bd-8b22-1785d0c5712f tempest-VolumeDependencyTests-1648079611 None] Lock "cinder-808c6ea3-3eed-48ad-8628-6d14967e8e1c-delete_snapshot" released by "delete_snapshot" :: held 1.524s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:48:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] Acquiring lock "cinder-0f97551d-e049-4f43-966a-ee340b985994-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:48:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] Lock "cinder-0f97551d-e049-4f43-966a-ee340b985994-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:48:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] Acquiring lock "cinder-quobyte-0f97551d-e049-4f43-966a-ee340b985994" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:48:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] Lock "cinder-quobyte-0f97551d-e049-4f43-966a-ee340b985994" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:48:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1b73bd-3526-4838-b9ce-246f2486dbdd]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:48:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:45 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 Jul 13 20:48:45 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:45 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994" returned: 0 in 0.349s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:45 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994 Jul 13 20:48:45 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:45 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0f97551d-e049-4f43-966a-ee340b985994" returned: 0 in 0.241s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] Lock "cinder-quobyte-0f97551d-e049-4f43-966a-ee340b985994" released by "delete_volume" :: held 0.650s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:48:45 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] Created reservations ['c6847fa7-a6ae-4a7a-9ae1-36d0bc39feb9', '1206202e-170b-4014-afa5-c3c37d39b514', 'a2549ad9-60e1-44c2-be0f-22a55723b27f', 'd9cc8543-aaaf-492f-9975-21a68832ad07'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:48:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:48:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:48:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:48:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:48:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:48:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:45 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:48:45 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:46 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.239s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:46 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:48:46 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] Deleted volume successfully. Jul 13 20:48:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cf4a698d-b0aa-4c27-a150-5d71fe51bc47 tempest-VolumeDependencyTests-1648079611 None] Lock "cinder-0f97551d-e049-4f43-966a-ee340b985994-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:48:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] Acquiring lock "cinder-726a744c-f63b-487f-9312-d3ba71efd6fb-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:48:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] Lock "cinder-726a744c-f63b-487f-9312-d3ba71efd6fb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:48:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] Acquiring lock "cinder-quobyte-726a744c-f63b-487f-9312-d3ba71efd6fb" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:48:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] Lock "cinder-quobyte-726a744c-f63b-487f-9312-d3ba71efd6fb" acquired by "delete_volume" :: waited 0.013s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:48:46 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4e89ed-c2aa-411e-8d2b-4a60b4311d07]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:48:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-726a744c-f63b-487f-9312-d3ba71efd6fb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:46 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-726a744c-f63b-487f-9312-d3ba71efd6fb Jul 13 20:48:46 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:46 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-726a744c-f63b-487f-9312-d3ba71efd6fb" returned: 0 in 0.354s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-726a744c-f63b-487f-9312-d3ba71efd6fb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:46 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-726a744c-f63b-487f-9312-d3ba71efd6fb Jul 13 20:48:46 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:46 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-726a744c-f63b-487f-9312-d3ba71efd6fb" returned: 0 in 0.239s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] Lock "cinder-quobyte-726a744c-f63b-487f-9312-d3ba71efd6fb" released by "delete_volume" :: held 0.629s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:48:46 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] Created reservations ['8b4ca575-6540-4789-a1d0-d125c959c04d', 'baf931ce-cfba-4ec5-a6c9-b2c0b5645fbf', 'a1b41e06-26d5-4612-bfb0-3b949567c30e', 'ae058abd-0c3a-4d91-9dd2-1b51328ff38c'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:48:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:48:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:48:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:48:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:48:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:48:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:48:47 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:48:47 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:48:47 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 13 20:48:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.244s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:48:47 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:48:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] Deleted volume successfully. Jul 13 20:48:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1e82e5fa-9b70-475e-bfac-7dda5112f2eb tempest-VolumeDependencyTests-1648079611 None] Lock "cinder-726a744c-f63b-487f-9312-d3ba71efd6fb-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:48:57 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=45,cinder:UPDATE=43,cinder:INSERT=13,cinder:DELETE=3 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:48:57 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=28,cinder:INSERT=16,cinder:UPDATE=38,cinder:DELETE=4 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Flow 'volume_create_manager' (258bd4f2-b019-4956-8d8e-1f35c66cc3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee61284-85c4-44a2-a44e-7fa52b0e1f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee61284-85c4-44a2-a44e-7fa52b0e1f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1322582258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b252cccc-88e3-48d9-9ace-467b02c1d51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23df052b0a9b44fcb3316a401ef7cf21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:03Z,use_quota=True,user_id='7b1f227670e843c19237945f9f044589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00aec582-5a62-4527-815e-f5573cedeb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00aec582-5a62-4527-815e-f5573cedeb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e57e56e-71ea-459c-a2e6-c0f39d592251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e57e56e-71ea-459c-a2e6-c0f39d592251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b252cccc-88e3-48d9-9ace-467b02c1d51e', 'volume_name': 'volume-b252cccc-88e3-48d9-9ace-467b02c1d51e', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e733f2-26a7-4d44-806c-43b084ad49e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e733f2-26a7-4d44-806c-43b084ad49e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c10b2ee-ce91-45e7-ab0f-4bd1b8f94f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:03 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Volume b252cccc-88e3-48d9-9ace-467b02c1d51e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b252cccc-88e3-48d9-9ace-467b02c1d51e', 'volume_size': 1} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1322582258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b252cccc-88e3-48d9-9ace-467b02c1d51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23df052b0a9b44fcb3316a401ef7cf21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:03Z,use_quota=True,user_id='7b1f227670e843c19237945f9f044589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Creating volume b252cccc-88e3-48d9-9ace-467b02c1d51e {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:03 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b252cccc-88e3-48d9-9ace-467b02c1d51e 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:03 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b252cccc-88e3-48d9-9ace-467b02c1d51e 1073741824 Jul 13 20:49:03 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Flow 'volume_create_manager' (984d592e-c763-47b2-b2fa-c0dfb1e4fe06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68212d9e-46ab-413b-b109-d36fb866a691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68212d9e-46ab-413b-b109-d36fb866a691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-953494900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f43123-d17c-4a66-afaa-848c9343b357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6634ca78f5459e9cd379240a2b0b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:03Z,use_quota=True,user_id='e61f68c51e064fc1a49ed3e11db2bf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82939437-624f-435c-bd76-968178c019b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82939437-624f-435c-bd76-968178c019b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b9ee2a-c79f-4728-9ce8-864c403ed7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b9ee2a-c79f-4728-9ce8-864c403ed7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8f43123-d17c-4a66-afaa-848c9343b357', 'volume_name': 'volume-b8f43123-d17c-4a66-afaa-848c9343b357', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65e9f9e-01a7-4b3a-bd82-0bbfb302fab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65e9f9e-01a7-4b3a-bd82-0bbfb302fab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f83d34-bf94-4980-a517-1172b913909e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:03 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Volume b8f43123-d17c-4a66-afaa-848c9343b357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8f43123-d17c-4a66-afaa-848c9343b357', 'volume_size': 1} Jul 13 20:49:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Flow 'volume_create_manager' (0e8c217d-f5c1-4a83-8b8f-68213b4823a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa74258-a07d-47bf-8d46-78ce8181315a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa74258-a07d-47bf-8d46-78ce8181315a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-744069702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501f8512-91f0-46f3-9fd7-257530a5b134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0a57e0f7e7413a9bdac0a8145edb9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:04Z,use_quota=True,user_id='a57240f4811643e3abceb380ee8db1ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15ed57e-b39e-420b-8c60-3c522a0e67e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15ed57e-b39e-420b-8c60-3c522a0e67e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da5dd03-3c2d-46fc-8863-ac7c8a8ce711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da5dd03-3c2d-46fc-8863-ac7c8a8ce711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '501f8512-91f0-46f3-9fd7-257530a5b134', 'volume_name': 'volume-501f8512-91f0-46f3-9fd7-257530a5b134', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1781b79-71e5-4b5d-aea9-14985d419d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1781b79-71e5-4b5d-aea9-14985d419d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:04 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ccb7a0d-d650-4dbb-acb9-cf3a46259fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Volume 501f8512-91f0-46f3-9fd7-257530a5b134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-501f8512-91f0-46f3-9fd7-257530a5b134', 'volume_size': 1} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b252cccc-88e3-48d9-9ace-467b02c1d51e 1073741824" returned: 0 in 0.564s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b252cccc-88e3-48d9-9ace-467b02c1d51e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:04 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b252cccc-88e3-48d9-9ace-467b02c1d51e Jul 13 20:49:04 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:04 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Flow 'volume_create_manager' (49991bad-fe8c-42ac-95d3-b287842cf46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7f349e-0ca0-4435-bfff-e48d11e1ca42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b252cccc-88e3-48d9-9ace-467b02c1d51e" returned: 0 in 0.393s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.882s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-953494900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f43123-d17c-4a66-afaa-848c9343b357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6634ca78f5459e9cd379240a2b0b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:03Z,use_quota=True,user_id='e61f68c51e064fc1a49ed3e11db2bf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Creating volume b8f43123-d17c-4a66-afaa-848c9343b357 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:04 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7f349e-0ca0-4435-bfff-e48d11e1ca42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1095501425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6812772-c4c1-48b9-ac00-97eccfefb160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0a57e0f7e7413a9bdac0a8145edb9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:04Z,use_quota=True,user_id='a57240f4811643e3abceb380ee8db1ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:04 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357 1073741824 Jul 13 20:49:04 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1453e139-4462-4009-beac-956213fcc60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1453e139-4462-4009-beac-956213fcc60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a107178d-d38c-4110-aba1-06e66a5b4732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a107178d-d38c-4110-aba1-06e66a5b4732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6812772-c4c1-48b9-ac00-97eccfefb160', 'volume_name': 'volume-f6812772-c4c1-48b9-ac00-97eccfefb160', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c37c00b-83e0-47b0-91eb-31c46d4aa5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c37c00b-83e0-47b0-91eb-31c46d4aa5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4223efa-b049-4aad-a6bb-069e8c43e9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Volume f6812772-c4c1-48b9-ac00-97eccfefb160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6812772-c4c1-48b9-ac00-97eccfefb160', 'volume_size': 1} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c10b2ee-ce91-45e7-ab0f-4bd1b8f94f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b252cccc-88e3-48d9-9ace-467b02c1d51e', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f8fd350-0d1c-4010-bfbc-584810dc3e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Volume volume-b252cccc-88e3-48d9-9ace-467b02c1d51e (b252cccc-88e3-48d9-9ace-467b02c1d51e): created successfully Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f8fd350-0d1c-4010-bfbc-584810dc3e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Flow 'volume_create_manager' (258bd4f2-b019-4956-8d8e-1f35c66cc3e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1d28613b-6a16-478a-8919-70957d0ddc46 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Created volume successfully. Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Flow 'volume_create_manager' (8d85c00f-2546-457a-a716-1b0ddf7578bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b1971c-bf98-4031-82f3-6e4682233779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b1971c-bf98-4031-82f3-6e4682233779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-654238122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8f58fb-5716-4074-866d-7eb596217f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0a57e0f7e7413a9bdac0a8145edb9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:05Z,use_quota=True,user_id='a57240f4811643e3abceb380ee8db1ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff835b95-12ec-4129-9822-96569e885484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff835b95-12ec-4129-9822-96569e885484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364f85c6-b027-42e6-afc2-987b6c89438a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364f85c6-b027-42e6-afc2-987b6c89438a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf8f58fb-5716-4074-866d-7eb596217f96', 'volume_name': 'volume-cf8f58fb-5716-4074-866d-7eb596217f96', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d447f8fe-f05d-41f4-8b79-94aeeab454a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d447f8fe-f05d-41f4-8b79-94aeeab454a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8888454a-68c0-4fff-a3bb-c44d02c52a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Volume cf8f58fb-5716-4074-866d-7eb596217f96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf8f58fb-5716-4074-866d-7eb596217f96', 'volume_size': 1} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:05 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357 1073741824" returned: 0 in 0.573s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:05 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357 Jul 13 20:49:05 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Flow 'volume_create_manager' (c85ed2c7-5e1f-473e-8542-cbed0bd211f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ee8033-da99-4b6f-8936-82a46996f4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:05 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ee8033-da99-4b6f-8936-82a46996f4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-311714552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf6450b-db16-44f6-bc0d-b9fbf7698f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0a57e0f7e7413a9bdac0a8145edb9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:05Z,use_quota=True,user_id='a57240f4811643e3abceb380ee8db1ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603b7e67-a3d2-4b5d-be8f-8d1ef276de2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603b7e67-a3d2-4b5d-be8f-8d1ef276de2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58904ef1-e089-4c53-aad4-55e97d17d45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58904ef1-e089-4c53-aad4-55e97d17d45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cf6450b-db16-44f6-bc0d-b9fbf7698f05', 'volume_name': 'volume-2cf6450b-db16-44f6-bc0d-b9fbf7698f05', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a0956d-7852-4e80-ab99-6f3cc7588398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a0956d-7852-4e80-ab99-6f3cc7588398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2718e535-67c2-4f22-8b76-39f6ee27c368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Volume 2cf6450b-db16-44f6-bc0d-b9fbf7698f05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cf6450b-db16-44f6-bc0d-b9fbf7698f05', 'volume_size': 1} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357" returned: 0 in 0.424s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.497s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-744069702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501f8512-91f0-46f3-9fd7-257530a5b134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0a57e0f7e7413a9bdac0a8145edb9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:04Z,use_quota=True,user_id='a57240f4811643e3abceb380ee8db1ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Creating volume 501f8512-91f0-46f3-9fd7-257530a5b134 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:05 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501f8512-91f0-46f3-9fd7-257530a5b134 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:05 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501f8512-91f0-46f3-9fd7-257530a5b134 1073741824 Jul 13 20:49:05 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f83d34-bf94-4980-a517-1172b913909e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f43123-d17c-4a66-afaa-848c9343b357', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (393eb48b-e91f-44b1-8ef1-b006a43ba432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Volume volume-b8f43123-d17c-4a66-afaa-848c9343b357 (b8f43123-d17c-4a66-afaa-848c9343b357): created successfully Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (393eb48b-e91f-44b1-8ef1-b006a43ba432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Flow 'volume_create_manager' (984d592e-c763-47b2-b2fa-c0dfb1e4fe06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-82e8dff4-4c3d-4b4d-91cd-e23d5efcbdd7 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Created volume successfully. Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Flow 'volume_create_manager' (1e7d37f8-71fc-43df-a1bb-7752e72e3940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (475c780e-c576-433c-becd-e3c98dd786a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (475c780e-c576-433c-becd-e3c98dd786a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-321327771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1603a4d-a763-4e56-acd9-183b2fa049e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0a57e0f7e7413a9bdac0a8145edb9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:06Z,use_quota=True,user_id='a57240f4811643e3abceb380ee8db1ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d335ec83-fcce-4f24-b907-61d454600f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d335ec83-fcce-4f24-b907-61d454600f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b087cf-c585-4332-b98d-4b6fb2274bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b087cf-c585-4332-b98d-4b6fb2274bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1603a4d-a763-4e56-acd9-183b2fa049e8', 'volume_name': 'volume-f1603a4d-a763-4e56-acd9-183b2fa049e8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3784bc-8564-46d6-8b92-b83031e4ff04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3784bc-8564-46d6-8b92-b83031e4ff04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb1ee42-040a-488b-b46a-1a4b68fdd82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Volume f1603a4d-a763-4e56-acd9-183b2fa049e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1603a4d-a763-4e56-acd9-183b2fa049e8', 'volume_size': 1} Jul 13 20:49:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Flow 'volume_create_manager' (00e44b6b-d748-416d-ade6-ebaaac4e508f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2008bde8-f8b9-40bd-b58c-2cbea343c97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2008bde8-f8b9-40bd-b58c-2cbea343c97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-60077294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d35e9dd-4089-40e5-8acf-9f69fd924508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23df052b0a9b44fcb3316a401ef7cf21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:06Z,use_quota=True,user_id='7b1f227670e843c19237945f9f044589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4bd37bf-10c0-4747-be2e-c3e4ac90ea8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:06 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4bd37bf-10c0-4747-be2e-c3e4ac90ea8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7633b933-a51f-4b52-abd7-8aae5f6ef19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7633b933-a51f-4b52-abd7-8aae5f6ef19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d35e9dd-4089-40e5-8acf-9f69fd924508', 'volume_name': 'volume-1d35e9dd-4089-40e5-8acf-9f69fd924508', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d13049a-a104-4657-9bc6-c42a01b2c93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d13049a-a104-4657-9bc6-c42a01b2c93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3555f6da-95f9-4601-bcac-cd5accc5fff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:06 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Volume 1d35e9dd-4089-40e5-8acf-9f69fd924508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d35e9dd-4089-40e5-8acf-9f69fd924508', 'volume_size': 1} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501f8512-91f0-46f3-9fd7-257530a5b134 1073741824" returned: 0 in 0.645s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501f8512-91f0-46f3-9fd7-257530a5b134 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:06 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501f8512-91f0-46f3-9fd7-257530a5b134 Jul 13 20:49:06 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Flow 'volume_create_manager' (d89f2789-97c6-491d-a3e5-62406e850e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43b3ad9-fe9f-4601-ad02-8420a0e949b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43b3ad9-fe9f-4601-ad02-8420a0e949b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-357358225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc5efcd-6d45-4941-a2b6-85443de67e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23df052b0a9b44fcb3316a401ef7cf21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:07Z,use_quota=True,user_id='7b1f227670e843c19237945f9f044589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b07695-8498-4e42-851a-29fba297e5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b07695-8498-4e42-851a-29fba297e5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f42e9f5-7d24-40ab-a081-d551acc3a367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f42e9f5-7d24-40ab-a081-d551acc3a367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bc5efcd-6d45-4941-a2b6-85443de67e38', 'volume_name': 'volume-0bc5efcd-6d45-4941-a2b6-85443de67e38', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790613ba-f59f-479a-a7b3-fb0330fb03f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790613ba-f59f-479a-a7b3-fb0330fb03f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a1bf81-fc30-4e29-aeda-cc38e613e3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:06 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Volume 0bc5efcd-6d45-4941-a2b6-85443de67e38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bc5efcd-6d45-4941-a2b6-85443de67e38', 'volume_size': 1} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:06 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501f8512-91f0-46f3-9fd7-257530a5b134" returned: 0 in 0.388s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.064s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1095501425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6812772-c4c1-48b9-ac00-97eccfefb160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0a57e0f7e7413a9bdac0a8145edb9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:04Z,use_quota=True,user_id='a57240f4811643e3abceb380ee8db1ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Creating volume f6812772-c4c1-48b9-ac00-97eccfefb160 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:06 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f6812772-c4c1-48b9-ac00-97eccfefb160 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:06 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f6812772-c4c1-48b9-ac00-97eccfefb160 1073741824 Jul 13 20:49:06 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ccb7a0d-d650-4dbb-acb9-cf3a46259fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-501f8512-91f0-46f3-9fd7-257530a5b134', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac922f6b-728f-4cec-875c-2bbdba848592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:06 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Volume volume-501f8512-91f0-46f3-9fd7-257530a5b134 (501f8512-91f0-46f3-9fd7-257530a5b134): created successfully Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac922f6b-728f-4cec-875c-2bbdba848592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Flow 'volume_create_manager' (0e8c217d-f5c1-4a83-8b8f-68213b4823a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-81eda8c2-0c70-4742-b447-aa76e8fbfebd tempest-CreateVolumesFromImageTest-1677743207 None] Created volume successfully. Jul 13 20:49:06 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Flow 'volume_create_manager' (a67bbd4b-8617-4329-9758-c3461cb41444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bd30e6-72fe-4a1a-a9b9-3b6a7dbf070f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bd30e6-72fe-4a1a-a9b9-3b6a7dbf070f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-688588055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7474e632-9171-4f55-b510-0b8be20ea630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23df052b0a9b44fcb3316a401ef7cf21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:07Z,use_quota=True,user_id='7b1f227670e843c19237945f9f044589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df95d34d-7caa-4fb2-9175-2b307cbb2ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df95d34d-7caa-4fb2-9175-2b307cbb2ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1a9b93-6572-4ea9-a78e-7b855ade4af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1a9b93-6572-4ea9-a78e-7b855ade4af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7474e632-9171-4f55-b510-0b8be20ea630', 'volume_name': 'volume-7474e632-9171-4f55-b510-0b8be20ea630', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ec5e39-768b-44f4-b9b0-01cd0af29115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ec5e39-768b-44f4-b9b0-01cd0af29115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc96279-a470-41f6-bf3b-b769440accd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:07 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Volume 7474e632-9171-4f55-b510-0b8be20ea630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7474e632-9171-4f55-b510-0b8be20ea630', 'volume_size': 1} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0e47fb4d-39ed-4408-bdd6-ad6d3ff74c0c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:07 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f6812772-c4c1-48b9-ac00-97eccfefb160 1073741824" returned: 0 in 0.586s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f6812772-c4c1-48b9-ac00-97eccfefb160 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:07 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f6812772-c4c1-48b9-ac00-97eccfefb160 Jul 13 20:49:07 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:07 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f6812772-c4c1-48b9-ac00-97eccfefb160" returned: 0 in 0.316s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.684s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-654238122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8f58fb-5716-4074-866d-7eb596217f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0a57e0f7e7413a9bdac0a8145edb9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:05Z,use_quota=True,user_id='a57240f4811643e3abceb380ee8db1ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Creating volume cf8f58fb-5716-4074-866d-7eb596217f96 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:07 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cf8f58fb-5716-4074-866d-7eb596217f96 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4223efa-b049-4aad-a6bb-069e8c43e9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6812772-c4c1-48b9-ac00-97eccfefb160', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:07 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cf8f58fb-5716-4074-866d-7eb596217f96 1073741824 Jul 13 20:49:07 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e5491e-cfdd-4132-8650-b01cbee7cbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:07 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Volume volume-f6812772-c4c1-48b9-ac00-97eccfefb160 (f6812772-c4c1-48b9-ac00-97eccfefb160): created successfully Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e5491e-cfdd-4132-8650-b01cbee7cbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Flow 'volume_create_manager' (49991bad-fe8c-42ac-95d3-b287842cf46a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-bdad0ce5-a2cd-461e-9e39-b2b8d2ea1c44 tempest-CreateVolumesFromImageTest-1677743207 None] Created volume successfully. Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Flow 'volume_create_manager' (d80eceb2-720d-490c-ad87-850b48621ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91056ece-5927-493c-a719-789af2d1f6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91056ece-5927-493c-a719-789af2d1f6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-367470499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9175bd0f-07f9-441a-bd6e-b34dd8b84d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23df052b0a9b44fcb3316a401ef7cf21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:08Z,use_quota=True,user_id='7b1f227670e843c19237945f9f044589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edeaac1f-5bc3-4e36-a493-31992ea2a2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edeaac1f-5bc3-4e36-a493-31992ea2a2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f145e14-a845-413d-b19a-212d23b503cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f145e14-a845-413d-b19a-212d23b503cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9175bd0f-07f9-441a-bd6e-b34dd8b84d93', 'volume_name': 'volume-9175bd0f-07f9-441a-bd6e-b34dd8b84d93', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947e6c2b-922c-4468-9185-2645f064d5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947e6c2b-922c-4468-9185-2645f064d5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3560f406-b932-4166-9b8f-0eb25d0b1912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:08 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Volume 9175bd0f-07f9-441a-bd6e-b34dd8b84d93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9175bd0f-07f9-441a-bd6e-b34dd8b84d93', 'volume_size': 1} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Flow 'volume_create_manager' (9c4d2f83-4ca0-44d3-acd9-c11b5e95b303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673f804f-5678-4501-9604-f5779e48798d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673f804f-5678-4501-9604-f5779e48798d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5026cb9b-d27a-41b0-a386-a6b901564e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7b7e8aa135404bbf2f245d9280c347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:08Z,use_quota=True,user_id='6372db52d9114407803e267e28709821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fdfd7a24-9624-4072-b4b9-325e5bcbbc44),volume_type_id=fdfd7a24-9624-4072-b4b9-325e5bcbbc44)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:08 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04321c06-a496-4587-8d9a-5b5a91d764f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04321c06-a496-4587-8d9a-5b5a91d764f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240b6529-9ff0-4a7c-a63f-b9f67ce7d20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.image.glance [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Creating Keystone auth plugin from conf {{(pid=87269) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cf8f58fb-5716-4074-866d-7eb596217f96 1073741824" returned: 0 in 0.530s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Flow 'volume_create_manager' (24b0c83c-8735-4b0a-b43c-d4d0b07f7766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35ed90e-10ad-4da7-a1e0-63da05f9f921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35ed90e-10ad-4da7-a1e0-63da05f9f921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-919846272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43ba820-4cfe-4dc7-97ac-24c00d193168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23df052b0a9b44fcb3316a401ef7cf21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:08Z,use_quota=True,user_id='7b1f227670e843c19237945f9f044589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6900c072-5c30-406c-9d1e-edc7a0e8120b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6900c072-5c30-406c-9d1e-edc7a0e8120b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e22c533f-c52b-4f70-b69b-56c72b1ccedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e22c533f-c52b-4f70-b69b-56c72b1ccedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b43ba820-4cfe-4dc7-97ac-24c00d193168', 'volume_name': 'volume-b43ba820-4cfe-4dc7-97ac-24c00d193168', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109b988b-7355-4cd0-9d70-61ff28331ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109b988b-7355-4cd0-9d70-61ff28331ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ccbfce8-060a-40c0-9c7c-0896ea7ed2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:08 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Volume b43ba820-4cfe-4dc7-97ac-24c00d193168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b43ba820-4cfe-4dc7-97ac-24c00d193168', 'volume_size': 1} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cf8f58fb-5716-4074-866d-7eb596217f96 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:08 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cf8f58fb-5716-4074-866d-7eb596217f96 Jul 13 20:49:08 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240b6529-9ff0-4a7c-a63f-b9f67ce7d20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5026cb9b-d27a-41b0-a386-a6b901564e03', 'volume_name': 'volume-5026cb9b-d27a-41b0-a386-a6b901564e03', 'volume_size': 1, 'image_id': '785f35d0-fb87-4047-84f6-8f39ba25bd66', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/785f35d0-fb87-4047-84f6-8f39ba25bd66', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9acb9ad32fbc9376ba69105e6d975703', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ac7b7e8aa135404bbf2f245d9280c347', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5196d211226f9d5cdf6dcc6bce4a4001d67b8dde8e722a61e5a70dbf3fba37a2c87faef17dc87462e5c58deed6ba72aeb3aaa17716ce280bcea922a042ca1fd4', 'id': '785f35d0-fb87-4047-84f6-8f39ba25bd66', 'created_at': datetime.datetime(2026, 7, 13, 18, 49, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 49, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/785f35d0-fb87-4047-84f6-8f39ba25bd66/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f5103a-9c15-44c0-87b8-ee97229aa421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f5103a-9c15-44c0-87b8-ee97229aa421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb4dcd49-b3f2-4fc3-80ca-3287f45e4d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:08 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Volume 5026cb9b-d27a-41b0-a386-a6b901564e03: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5026cb9b-d27a-41b0-a386-a6b901564e03', 'volume_size': 1, 'image_id': '785f35d0-fb87-4047-84f6-8f39ba25bd66', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/785f35d0-fb87-4047-84f6-8f39ba25bd66', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9acb9ad32fbc9376ba69105e6d975703', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ac7b7e8aa135404bbf2f245d9280c347', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5196d211226f9d5cdf6dcc6bce4a4001d67b8dde8e722a61e5a70dbf3fba37a2c87faef17dc87462e5c58deed6ba72aeb3aaa17716ce280bcea922a042ca1fd4', 'id': '785f35d0-fb87-4047-84f6-8f39ba25bd66', 'created_at': datetime.datetime(2026, 7, 13, 18, 49, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 49, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/785f35d0-fb87-4047-84f6-8f39ba25bd66/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Trying to clone 5026cb9b-d27a-41b0-a386-a6b901564e03 from image 785f35d0-fb87-4047-84f6-8f39ba25bd66 at location (None, [{'url': 'file:///opt/stack/data/glance/images/785f35d0-fb87-4047-84f6-8f39ba25bd66', 'metadata': {}}]). {{(pid=87269) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 13 20:49:08 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Image download 0.00 MB at 0.00 MB/s Jul 13 20:49:08 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cf8f58fb-5716-4074-866d-7eb596217f96" returned: 0 in 0.257s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-311714552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf6450b-db16-44f6-bc0d-b9fbf7698f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0a57e0f7e7413a9bdac0a8145edb9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:05Z,use_quota=True,user_id='a57240f4811643e3abceb380ee8db1ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Creating volume 2cf6450b-db16-44f6-bc0d-b9fbf7698f05 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:08 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2cf6450b-db16-44f6-bc0d-b9fbf7698f05 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:08 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2cf6450b-db16-44f6-bc0d-b9fbf7698f05 1073741824 Jul 13 20:49:08 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8888454a-68c0-4fff-a3bb-c44d02c52a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf8f58fb-5716-4074-866d-7eb596217f96', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed2a0a6-bc1c-41d0-af67-f7f3e7a34b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe9d1f9-be8e-45eb-bb69-4dc5a85cda31]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:08 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Volume volume-cf8f58fb-5716-4074-866d-7eb596217f96 (cf8f58fb-5716-4074-866d-7eb596217f96): created successfully Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed2a0a6-bc1c-41d0-af67-f7f3e7a34b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Flow 'volume_create_manager' (8d85c00f-2546-457a-a716-1b0ddf7578bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0a6011b5-ca9b-4ff3-bb38-99f00679f478 tempest-CreateVolumesFromImageTest-1677743207 None] Created volume successfully. Jul 13 20:49:08 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD Jul 13 20:49:08 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:09 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:09 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2cf6450b-db16-44f6-bc0d-b9fbf7698f05 1073741824" returned: 0 in 0.423s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2cf6450b-db16-44f6-bc0d-b9fbf7698f05 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:09 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2cf6450b-db16-44f6-bc0d-b9fbf7698f05 Jul 13 20:49:09 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:09 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD Jul 13 20:49:09 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:09 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2cf6450b-db16-44f6-bc0d-b9fbf7698f05" returned: 0 in 0.249s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.442s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-321327771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1603a4d-a763-4e56-acd9-183b2fa049e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0a57e0f7e7413a9bdac0a8145edb9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:06Z,use_quota=True,user_id='a57240f4811643e3abceb380ee8db1ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Creating volume f1603a4d-a763-4e56-acd9-183b2fa049e8 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:09 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1603a4d-a763-4e56-acd9-183b2fa049e8 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:09 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2718e535-67c2-4f22-8b76-39f6ee27c368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf6450b-db16-44f6-bc0d-b9fbf7698f05', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2cdf2a-4ed7-4eda-8b78-f002cd9f185a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:09 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1603a4d-a763-4e56-acd9-183b2fa049e8 1073741824 Jul 13 20:49:09 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Temporary image 785f35d0-fb87-4047-84f6-8f39ba25bd66 is fetched for user 6372db52d9114407803e267e28709821. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 13 20:49:09 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Volume volume-2cf6450b-db16-44f6-bc0d-b9fbf7698f05 (2cf6450b-db16-44f6-bc0d-b9fbf7698f05): created successfully Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2cdf2a-4ed7-4eda-8b78-f002cd9f185a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Flow 'volume_create_manager' (c85ed2c7-5e1f-473e-8542-cbed0bd211f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d7691077-ab1c-4d08-bb89-13faba7bde86 tempest-CreateVolumesFromImageTest-1677743207 None] Created volume successfully. Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6c167a-56f1-4aa9-a05c-62cdaab6dd35]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:09 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD Jul 13 20:49:09 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:09 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1603a4d-a763-4e56-acd9-183b2fa049e8 1073741824" returned: 0 in 0.420s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:09 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1603a4d-a763-4e56-acd9-183b2fa049e8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:09 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1603a4d-a763-4e56-acd9-183b2fa049e8 Jul 13 20:49:09 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:09 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD Jul 13 20:49:09 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:10 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1603a4d-a763-4e56-acd9-183b2fa049e8" returned: 0 in 0.243s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.780s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-60077294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d35e9dd-4089-40e5-8acf-9f69fd924508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23df052b0a9b44fcb3316a401ef7cf21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:06Z,use_quota=True,user_id='7b1f227670e843c19237945f9f044589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Creating volume 1d35e9dd-4089-40e5-8acf-9f69fd924508 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:10 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1d35e9dd-4089-40e5-8acf-9f69fd924508 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb1ee42-040a-488b-b46a-1a4b68fdd82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1603a4d-a763-4e56-acd9-183b2fa049e8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:10 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1d35e9dd-4089-40e5-8acf-9f69fd924508 1073741824 Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43eec345-ab23-492a-aac8-057d7e14b9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:10 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:10 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Volume volume-f1603a4d-a763-4e56-acd9-183b2fa049e8 (f1603a4d-a763-4e56-acd9-183b2fa049e8): created successfully Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43eec345-ab23-492a-aac8-057d7e14b9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Flow 'volume_create_manager' (1e7d37f8-71fc-43df-a1bb-7752e72e3940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:10 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7b38b68c-00c0-4f0f-9ae6-ae26af89096d tempest-CreateVolumesFromImageTest-1677743207 None] Created volume successfully. Jul 13 20:49:10 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "cinder-f1603a4d-a763-4e56-acd9-183b2fa049e8-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-f1603a4d-a763-4e56-acd9-183b2fa049e8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "cinder-quobyte-f1603a4d-a763-4e56-acd9-183b2fa049e8" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-quobyte-f1603a4d-a763-4e56-acd9-183b2fa049e8" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0cb6b5-21d9-460a-bcc1-fd1f58c3c7ae]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1603a4d-a763-4e56-acd9-183b2fa049e8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:10 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1d35e9dd-4089-40e5-8acf-9f69fd924508 1073741824" returned: 0 in 0.459s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1d35e9dd-4089-40e5-8acf-9f69fd924508 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:10 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1603a4d-a763-4e56-acd9-183b2fa049e8 Jul 13 20:49:10 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:10 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1d35e9dd-4089-40e5-8acf-9f69fd924508 Jul 13 20:49:10 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:10 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1d35e9dd-4089-40e5-8acf-9f69fd924508" returned: 0 in 0.244s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.127s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-357358225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc5efcd-6d45-4941-a2b6-85443de67e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23df052b0a9b44fcb3316a401ef7cf21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:07Z,use_quota=True,user_id='7b1f227670e843c19237945f9f044589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Creating volume 0bc5efcd-6d45-4941-a2b6-85443de67e38 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:10 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0bc5efcd-6d45-4941-a2b6-85443de67e38 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:10 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3555f6da-95f9-4601-bcac-cd5accc5fff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d35e9dd-4089-40e5-8acf-9f69fd924508', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:10 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0bc5efcd-6d45-4941-a2b6-85443de67e38 1073741824 Jul 13 20:49:10 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515ac885-f284-4d52-b9ec-953211fb0b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1603a4d-a763-4e56-acd9-183b2fa049e8" returned: 0 in 0.404s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1603a4d-a763-4e56-acd9-183b2fa049e8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:10 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Volume volume-1d35e9dd-4089-40e5-8acf-9f69fd924508 (1d35e9dd-4089-40e5-8acf-9f69fd924508): created successfully Jul 13 20:49:10 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1603a4d-a763-4e56-acd9-183b2fa049e8 Jul 13 20:49:10 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515ac885-f284-4d52-b9ec-953211fb0b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Flow 'volume_create_manager' (00e44b6b-d748-416d-ade6-ebaaac4e508f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:10 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-33443fc5-9300-4bc8-9900-5f1971063ff8 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Created volume successfully. Jul 13 20:49:11 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1603a4d-a763-4e56-acd9-183b2fa049e8" returned: 0 in 0.260s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-quobyte-f1603a4d-a763-4e56-acd9-183b2fa049e8" released by "delete_volume" :: held 0.707s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] Created reservations ['1bd0358a-d64a-48f0-a996-f6013580e0ea', '985a1635-8a8b-44d1-ab58-539555a30d4f', 'd0dd929e-e9e3-407e-9db3-6903ec5064dd', 'eee7fdef-5260-4a27-b723-65d5dc7b2741'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:11 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:11 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:11 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0bc5efcd-6d45-4941-a2b6-85443de67e38 1073741824" returned: 0 in 0.479s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0bc5efcd-6d45-4941-a2b6-85443de67e38 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:11 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0bc5efcd-6d45-4941-a2b6-85443de67e38 Jul 13 20:49:11 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "cinder-2cf6450b-db16-44f6-bc0d-b9fbf7698f05-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:11 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.263s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] Deleted volume successfully. Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-2cf6450b-db16-44f6-bc0d-b9fbf7698f05-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b20708aa-241a-4adf-88f5-45829e0d3934 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-f1603a4d-a763-4e56-acd9-183b2fa049e8-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "cinder-quobyte-2cf6450b-db16-44f6-bc0d-b9fbf7698f05" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-quobyte-2cf6450b-db16-44f6-bc0d-b9fbf7698f05" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:11 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0bc5efcd-6d45-4941-a2b6-85443de67e38" returned: 0 in 0.285s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.565s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-688588055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7474e632-9171-4f55-b510-0b8be20ea630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23df052b0a9b44fcb3316a401ef7cf21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:07Z,use_quota=True,user_id='7b1f227670e843c19237945f9f044589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Creating volume 7474e632-9171-4f55-b510-0b8be20ea630 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:11 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7474e632-9171-4f55-b510-0b8be20ea630 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1761c4c5-7b44-4c1d-a9ed-0a54aabb0209]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2cf6450b-db16-44f6-bc0d-b9fbf7698f05 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:11 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7474e632-9171-4f55-b510-0b8be20ea630 1073741824 Jul 13 20:49:11 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a1bf81-fc30-4e29-aeda-cc38e613e3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bc5efcd-6d45-4941-a2b6-85443de67e38', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa421085-d014-4047-8dc1-d22adc1e15a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:11 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Volume volume-0bc5efcd-6d45-4941-a2b6-85443de67e38 (0bc5efcd-6d45-4941-a2b6-85443de67e38): created successfully Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa421085-d014-4047-8dc1-d22adc1e15a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Flow 'volume_create_manager' (d89f2789-97c6-491d-a3e5-62406e850e9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3445aaf1-88e6-4dde-b36b-73141b56e258 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Created volume successfully. Jul 13 20:49:11 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2cf6450b-db16-44f6-bc0d-b9fbf7698f05 Jul 13 20:49:11 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:12 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2cf6450b-db16-44f6-bc0d-b9fbf7698f05" returned: 0 in 0.376s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2cf6450b-db16-44f6-bc0d-b9fbf7698f05 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:12 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2cf6450b-db16-44f6-bc0d-b9fbf7698f05 Jul 13 20:49:12 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:12 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7474e632-9171-4f55-b510-0b8be20ea630 1073741824" returned: 0 in 0.430s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7474e632-9171-4f55-b510-0b8be20ea630 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:12 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7474e632-9171-4f55-b510-0b8be20ea630 Jul 13 20:49:12 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:12 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2cf6450b-db16-44f6-bc0d-b9fbf7698f05" returned: 0 in 0.260s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-quobyte-2cf6450b-db16-44f6-bc0d-b9fbf7698f05" released by "delete_volume" :: held 0.694s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] Created reservations ['cd30b171-fc4f-422a-bc14-405c1a9e64b9', '2f1257f4-3689-4d7a-8c98-be85aa32aff1', '281babc5-3c7e-43df-a751-d841b494cfe9', '867ae54c-16b7-40f1-bb9a-2ad6922aee33'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:12 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7474e632-9171-4f55-b510-0b8be20ea630" returned: 0 in 0.266s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0e47fb4d-39ed-4408-bdd6-ad6d3ff74c0c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.292s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc96279-a470-41f6-bf3b-b769440accd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7474e632-9171-4f55-b510-0b8be20ea630', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4813b5fe-bf26-4b1e-ade5-e31527de1ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0e47fb4d-39ed-4408-bdd6-ad6d3ff74c0c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Creating offline snapshot 9b3fd5fe-2474-4467-bac7-6920629e702e of volume b8f43123-d17c-4a66-afaa-848c9343b357 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[39aed507-e6a0-4bca-9183-9c48f3258f1f]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e47fb4d-39ed-4408-bdd6-ad6d3ff74c0c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:12 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Volume volume-7474e632-9171-4f55-b510-0b8be20ea630 (7474e632-9171-4f55-b510-0b8be20ea630): created successfully Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4813b5fe-bf26-4b1e-ade5-e31527de1ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Flow 'volume_create_manager' (a67bbd4b-8617-4329-9758-c3461cb41444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-71e08f38-8fd6-46ed-b057-347acc17de5c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Created volume successfully. Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:12 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:12 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:12 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357 Jul 13 20:49:12 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "cinder-cf8f58fb-5716-4074-866d-7eb596217f96-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-cf8f58fb-5716-4074-866d-7eb596217f96-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "cinder-quobyte-cf8f58fb-5716-4074-866d-7eb596217f96" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:12 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.285s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-quobyte-cf8f58fb-5716-4074-866d-7eb596217f96" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] Deleted volume successfully. Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[900e51cf-d1f3-4814-9819-224eef603cdd]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cf8f58fb-5716-4074-866d-7eb596217f96 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92f83833-9337-465e-9612-23524e10f5bc tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-2cf6450b-db16-44f6-bc0d-b9fbf7698f05-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:12 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e47fb4d-39ed-4408-bdd6-ad6d3ff74c0c tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357" returned: 0 in 0.417s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e47fb4d-39ed-4408-bdd6-ad6d3ff74c0c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:12 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e 1G Jul 13 20:49:12 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:12 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cf8f58fb-5716-4074-866d-7eb596217f96 Jul 13 20:49:12 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:13 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cf8f58fb-5716-4074-866d-7eb596217f96" returned: 0 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cf8f58fb-5716-4074-866d-7eb596217f96 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:13 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cf8f58fb-5716-4074-866d-7eb596217f96 Jul 13 20:49:13 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:13 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e47fb4d-39ed-4408-bdd6-ad6d3ff74c0c tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e 1G" returned: 0 in 0.418s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e47fb4d-39ed-4408-bdd6-ad6d3ff74c0c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8f43123-d17c-4a66-afaa-848c9343b357 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:13 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8f43123-d17c-4a66-afaa-848c9343b357 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e Jul 13 20:49:13 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:13 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cf8f58fb-5716-4074-866d-7eb596217f96" returned: 0 in 0.282s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-quobyte-cf8f58fb-5716-4074-866d-7eb596217f96" released by "delete_volume" :: held 0.712s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] Created reservations ['068ee17d-166a-4e80-a131-a18edae0759a', '646b33e8-ee6f-4cf9-8150-ce8d7997e517', '77b2cda3-0fac-480f-8d08-53896175622d', '32ed1143-6b74-4090-a2e4-f6faf87394b0'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:13 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e47fb4d-39ed-4408-bdd6-ad6d3ff74c0c tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8f43123-d17c-4a66-afaa-848c9343b357 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e" returned: 0 in 0.322s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:13 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-0e47fb4d-39ed-4408-bdd6-ad6d3ff74c0c tempest-CreateVolumesFromSnapshotTest-2039620683 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e is being set with open permissions: ugo+rw Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e47fb4d-39ed-4408-bdd6-ad6d3ff74c0c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:13 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e Jul 13 20:49:13 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:13 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:13 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:13 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e47fb4d-39ed-4408-bdd6-ad6d3ff74c0c tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e" returned: 0 in 0.260s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "cinder-f6812772-c4c1-48b9-ac00-97eccfefb160-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:13 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e47fb4d-39ed-4408-bdd6-ad6d3ff74c0c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.273s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-f6812772-c4c1-48b9-ac00-97eccfefb160-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:13 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.info Jul 13 20:49:13 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] Deleted volume successfully. Jul 13 20:49:13 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f407d8fe-7b9e-4be1-a886-3781b3bd3c60 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-cf8f58fb-5716-4074-866d-7eb596217f96-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "cinder-quobyte-f6812772-c4c1-48b9-ac00-97eccfefb160" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-quobyte-f6812772-c4c1-48b9-ac00-97eccfefb160" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8b3f25-91c1-46c2-af9b-6ddceb172d32]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f6812772-c4c1-48b9-ac00-97eccfefb160 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:14 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f6812772-c4c1-48b9-ac00-97eccfefb160 Jul 13 20:49:14 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:14 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e47fb4d-39ed-4408-bdd6-ad6d3ff74c0c tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.info" returned: 0 in 0.289s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:14 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-0e47fb4d-39ed-4408-bdd6-ad6d3ff74c0c tempest-CreateVolumesFromSnapshotTest-2039620683 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.info is being set with open permissions: ugo+rw Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e47fb4d-39ed-4408-bdd6-ad6d3ff74c0c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:14 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.info Jul 13 20:49:14 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:14 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f6812772-c4c1-48b9-ac00-97eccfefb160" returned: 0 in 0.354s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f6812772-c4c1-48b9-ac00-97eccfefb160 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:14 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f6812772-c4c1-48b9-ac00-97eccfefb160 Jul 13 20:49:14 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:14 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e47fb4d-39ed-4408-bdd6-ad6d3ff74c0c tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.info" returned: 0 in 0.266s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0e47fb4d-39ed-4408-bdd6-ad6d3ff74c0c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.118s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.416s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-367470499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9175bd0f-07f9-441a-bd6e-b34dd8b84d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23df052b0a9b44fcb3316a401ef7cf21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:08Z,use_quota=True,user_id='7b1f227670e843c19237945f9f044589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Creating volume 9175bd0f-07f9-441a-bd6e-b34dd8b84d93 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:14 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9175bd0f-07f9-441a-bd6e-b34dd8b84d93 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:14 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9175bd0f-07f9-441a-bd6e-b34dd8b84d93 1073741824 Jul 13 20:49:14 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0e47fb4d-39ed-4408-bdd6-ad6d3ff74c0c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Create snapshot completed successfully Jul 13 20:49:14 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f6812772-c4c1-48b9-ac00-97eccfefb160" returned: 0 in 0.256s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-quobyte-f6812772-c4c1-48b9-ac00-97eccfefb160" released by "delete_volume" :: held 0.662s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] Created reservations ['f124d95e-ff33-4962-a2ef-1890e2c854ff', '436a8ace-736a-4db9-8d71-3f35962bb29d', '68dbefd2-782b-4506-bf82-4924a0eb1e3f', '55bb6fa6-e94d-486f-afa0-799e22940494'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:14 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:14 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "cinder-501f8512-91f0-46f3-9fd7-257530a5b134-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-501f8512-91f0-46f3-9fd7-257530a5b134-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:15 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:15 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9175bd0f-07f9-441a-bd6e-b34dd8b84d93 1073741824" returned: 0 in 0.647s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.368s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] Deleted volume successfully. Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "cinder-quobyte-501f8512-91f0-46f3-9fd7-257530a5b134" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9175bd0f-07f9-441a-bd6e-b34dd8b84d93 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58ae7936-c5f9-483c-b30a-85765432564b tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-f6812772-c4c1-48b9-ac00-97eccfefb160-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-quobyte-501f8512-91f0-46f3-9fd7-257530a5b134" acquired by "delete_volume" :: waited 0.041s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:15 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9175bd0f-07f9-441a-bd6e-b34dd8b84d93 Jul 13 20:49:15 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbb7389-a7eb-4f96-8f74-edfec332e8ef]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501f8512-91f0-46f3-9fd7-257530a5b134 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Flow 'volume_create_manager' (55260ed6-9e63-48e7-a51e-9777fa1c7609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da546b27-200d-491d-879f-e61847007b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:15 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501f8512-91f0-46f3-9fd7-257530a5b134 Jul 13 20:49:15 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da546b27-200d-491d-879f-e61847007b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-898702108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a2aa84-8917-4f03-9dd6-231c4a24e93a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6634ca78f5459e9cd379240a2b0b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:15Z,use_quota=True,user_id='e61f68c51e064fc1a49ed3e11db2bf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa69f19-af52-45e3-bde5-b073cc60936a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa69f19-af52-45e3-bde5-b073cc60936a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5427210d-8b3f-4b30-832a-78fc8c64f7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5427210d-8b3f-4b30-832a-78fc8c64f7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8a2aa84-8917-4f03-9dd6-231c4a24e93a', 'volume_name': 'volume-c8a2aa84-8917-4f03-9dd6-231c4a24e93a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40fb2a7-9e75-4099-9f8d-d4ab7fb98bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40fb2a7-9e75-4099-9f8d-d4ab7fb98bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa107396-a075-4991-a97f-dc00a8c9250d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:15 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Volume c8a2aa84-8917-4f03-9dd6-231c4a24e93a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8a2aa84-8917-4f03-9dd6-231c4a24e93a', 'volume_size': 1} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:15 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9175bd0f-07f9-441a-bd6e-b34dd8b84d93" returned: 0 in 0.336s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.235s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-919846272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43ba820-4cfe-4dc7-97ac-24c00d193168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23df052b0a9b44fcb3316a401ef7cf21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:08Z,use_quota=True,user_id='7b1f227670e843c19237945f9f044589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Creating volume b43ba820-4cfe-4dc7-97ac-24c00d193168 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:15 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b43ba820-4cfe-4dc7-97ac-24c00d193168 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:15 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b43ba820-4cfe-4dc7-97ac-24c00d193168 1073741824 Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3560f406-b932-4166-9b8f-0eb25d0b1912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9175bd0f-07f9-441a-bd6e-b34dd8b84d93', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:15 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed2b5cf1-e67b-4d73-96de-5ab9080515e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:15 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Volume volume-9175bd0f-07f9-441a-bd6e-b34dd8b84d93 (9175bd0f-07f9-441a-bd6e-b34dd8b84d93): created successfully Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed2b5cf1-e67b-4d73-96de-5ab9080515e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Flow 'volume_create_manager' (d80eceb2-720d-490c-ad87-850b48621ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c128abee-aee6-4baf-b317-49172a5b9911 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Created volume successfully. Jul 13 20:49:15 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501f8512-91f0-46f3-9fd7-257530a5b134" returned: 0 in 0.470s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501f8512-91f0-46f3-9fd7-257530a5b134 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:15 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501f8512-91f0-46f3-9fd7-257530a5b134 Jul 13 20:49:15 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Flow 'volume_create_manager' (30a58c62-1b87-4001-8839-81916c19199a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f840b81-ae71-4dd1-ad68-6e4a5eddb7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f840b81-ae71-4dd1-ad68-6e4a5eddb7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1651931751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6634ca78f5459e9cd379240a2b0b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:16Z,use_quota=True,user_id='e61f68c51e064fc1a49ed3e11db2bf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588524f1-dccc-46bb-8a16-2c24cc52c476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588524f1-dccc-46bb-8a16-2c24cc52c476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1713db-de39-4d20-bc06-8be1bbdaaa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1713db-de39-4d20-bc06-8be1bbdaaa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d', 'volume_name': 'volume-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1602ff-5d09-49f9-b108-b6f71cab8855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1602ff-5d09-49f9-b108-b6f71cab8855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ccd9242-75bf-4fec-85ad-e5ddb4b5bfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:15 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Volume 9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d', 'volume_size': 1} Jul 13 20:49:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:16 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-501f8512-91f0-46f3-9fd7-257530a5b134" returned: 0 in 0.286s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-quobyte-501f8512-91f0-46f3-9fd7-257530a5b134" released by "delete_volume" :: held 0.813s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] Created reservations ['648ed4cf-e581-4bef-8b74-6249e2956bec', 'dcc1eff8-f773-48f8-8da4-38869467e2d4', '6ffec129-1da3-4c9f-92d2-fa3460c454fb', 'bbb65dc5-8f7d-404a-950a-55e6388ad8f2'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:16 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b43ba820-4cfe-4dc7-97ac-24c00d193168 1073741824" returned: 0 in 0.581s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b43ba820-4cfe-4dc7-97ac-24c00d193168 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:16 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:16 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:16 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b43ba820-4cfe-4dc7-97ac-24c00d193168 Jul 13 20:49:16 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Flow 'volume_create_manager' (26959960-270f-4385-b17f-d6acccbb0aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a610c6d-266b-4bef-a1b2-b081c7e55282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a610c6d-266b-4bef-a1b2-b081c7e55282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-831535066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c5a36c2-81c2-48ad-83af-a0d15570a840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6634ca78f5459e9cd379240a2b0b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:16Z,use_quota=True,user_id='e61f68c51e064fc1a49ed3e11db2bf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe234988-fab9-4e80-bfa7-5705ef67f0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe234988-fab9-4e80-bfa7-5705ef67f0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f4c537-f05c-4edf-854e-e89631949842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f4c537-f05c-4edf-854e-e89631949842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c5a36c2-81c2-48ad-83af-a0d15570a840', 'volume_name': 'volume-0c5a36c2-81c2-48ad-83af-a0d15570a840', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1ee225-e710-421d-9c4c-286a00102cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1ee225-e710-421d-9c4c-286a00102cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318af96a-a47f-4cee-a950-df431c89ebe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:16 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Volume 0c5a36c2-81c2-48ad-83af-a0d15570a840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c5a36c2-81c2-48ad-83af-a0d15570a840', 'volume_size': 1} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:16 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.332s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] Deleted volume successfully. Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2d2b654c-23ef-456e-9b01-5eeec87c98c6 tempest-CreateVolumesFromImageTest-1677743207 None] Lock "cinder-501f8512-91f0-46f3-9fd7-257530a5b134-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:16 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b43ba820-4cfe-4dc7-97ac-24c00d193168" returned: 0 in 0.424s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.529s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5026cb9b-d27a-41b0-a386-a6b901564e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7b7e8aa135404bbf2f245d9280c347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:08Z,use_quota=True,user_id='6372db52d9114407803e267e28709821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fdfd7a24-9624-4072-b4b9-325e5bcbbc44),volume_type_id=fdfd7a24-9624-4072-b4b9-325e5bcbbc44)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Creating volume 5026cb9b-d27a-41b0-a386-a6b901564e03 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:16 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:16 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 1073741824 Jul 13 20:49:16 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ccbfce8-060a-40c0-9c7c-0896ea7ed2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43ba820-4cfe-4dc7-97ac-24c00d193168', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be9878e2-5e2c-4bdc-933b-d9e5815e9ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Flow 'volume_create_manager' (3661ee18-a84c-48dd-a761-12f9f6b14643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ef1250-6860-45d9-86f9-79d5749c1459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:16 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Volume volume-b43ba820-4cfe-4dc7-97ac-24c00d193168 (b43ba820-4cfe-4dc7-97ac-24c00d193168): created successfully Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be9878e2-5e2c-4bdc-933b-d9e5815e9ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Flow 'volume_create_manager' (24b0c83c-8735-4b0a-b43c-d4d0b07f7766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ef1250-6860-45d9-86f9-79d5749c1459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-315306986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b25be8-71c6-451f-8293-cd5384c19076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6634ca78f5459e9cd379240a2b0b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:17Z,use_quota=True,user_id='e61f68c51e064fc1a49ed3e11db2bf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd2b991-81ed-4f2b-b9a4-896d8175ffe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd2b991-81ed-4f2b-b9a4-896d8175ffe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fca336-89f7-4789-92c3-38dcc7702cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fca336-89f7-4789-92c3-38dcc7702cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61b25be8-71c6-451f-8293-cd5384c19076', 'volume_name': 'volume-61b25be8-71c6-451f-8293-cd5384c19076', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79c05e0-57eb-4a39-a0d7-116548c9a1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79c05e0-57eb-4a39-a0d7-116548c9a1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc2eec3-1c12-4115-8f58-d3c372d4de5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:16 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Volume 61b25be8-71c6-451f-8293-cd5384c19076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61b25be8-71c6-451f-8293-cd5384c19076', 'volume_size': 1} Jul 13 20:49:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d3ac7dfb-87ce-4560-94bc-72ede618c8ad tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Created volume successfully. Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:17 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Flow 'volume_create_manager' (2569c319-ec95-4d5f-b966-40959b1495c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4217b5a-35d0-4989-9804-6cdb19037485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 1073741824" returned: 0 in 0.629s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4217b5a-35d0-4989-9804-6cdb19037485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1828089462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd9aa47-60bd-4c39-bed2-dd35c265372f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6634ca78f5459e9cd379240a2b0b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:17Z,use_quota=True,user_id='e61f68c51e064fc1a49ed3e11db2bf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26792a6-6b01-4b05-9c7e-945eee630bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26792a6-6b01-4b05-9c7e-945eee630bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d83af0d2-5ecc-415a-ab39-73176638dc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d83af0d2-5ecc-415a-ab39-73176638dc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bd9aa47-60bd-4c39-bed2-dd35c265372f', 'volume_name': 'volume-2bd9aa47-60bd-4c39-bed2-dd35c265372f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0c7786-de82-4dd6-bdc5-685a134f471f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0c7786-de82-4dd6-bdc5-685a134f471f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5792d9b5-7aa6-45d7-8cd2-c7ea93a12da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:17 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Volume 2bd9aa47-60bd-4c39-bed2-dd35c265372f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bd9aa47-60bd-4c39-bed2-dd35c265372f', 'volume_size': 1} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:17 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 Jul 13 20:49:17 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:17 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03" returned: 0 in 0.271s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.170s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-898702108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a2aa84-8917-4f03-9dd6-231c4a24e93a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6634ca78f5459e9cd379240a2b0b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:15Z,use_quota=True,user_id='e61f68c51e064fc1a49ed3e11db2bf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Creating volume c8a2aa84-8917-4f03-9dd6-231c4a24e93a {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:17 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c8a2aa84-8917-4f03-9dd6-231c4a24e93a 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:17 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c8a2aa84-8917-4f03-9dd6-231c4a24e93a 1073741824 Jul 13 20:49:17 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Attempting download of 785f35d0-fb87-4047-84f6-8f39ba25bd66 ((None, [{'url': 'file:///opt/stack/data/glance/images/785f35d0-fb87-4047-84f6-8f39ba25bd66', 'metadata': {}}])) to volume 5026cb9b-d27a-41b0-a386-a6b901564e03. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9228062-d264-4cde-a42a-6164375c8fa3]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_785f35d0-fb87-4047-84f6-8f39ba25bd66_oe3x7cde {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:18 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_785f35d0-fb87-4047-84f6-8f39ba25bd66_oe3x7cde Jul 13 20:49:18 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "cinder-b43ba820-4cfe-4dc7-97ac-24c00d193168-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-b43ba820-4cfe-4dc7-97ac-24c00d193168-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "cinder-quobyte-b43ba820-4cfe-4dc7-97ac-24c00d193168" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-quobyte-b43ba820-4cfe-4dc7-97ac-24c00d193168" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[482f63ad-ebbd-4e67-a99c-ecb1b46a4aec]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b43ba820-4cfe-4dc7-97ac-24c00d193168 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:18 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_785f35d0-fb87-4047-84f6-8f39ba25bd66_oe3x7cde" returned: 0 in 0.408s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_785f35d0-fb87-4047-84f6-8f39ba25bd66_oe3x7cde {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:18 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b43ba820-4cfe-4dc7-97ac-24c00d193168 Jul 13 20:49:18 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:18 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_785f35d0-fb87-4047-84f6-8f39ba25bd66_oe3x7cde Jul 13 20:49:18 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:18 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c8a2aa84-8917-4f03-9dd6-231c4a24e93a 1073741824" returned: 0 in 0.716s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c8a2aa84-8917-4f03-9dd6-231c4a24e93a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:18 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c8a2aa84-8917-4f03-9dd6-231c4a24e93a Jul 13 20:49:18 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:18 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:18 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_785f35d0-fb87-4047-84f6-8f39ba25bd66_oe3x7cde" returned: 1 in 0.385s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_785f35d0-fb87-4047-84f6-8f39ba25bd66_oe3x7cde' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b43ba820-4cfe-4dc7-97ac-24c00d193168" returned: 0 in 0.498s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b43ba820-4cfe-4dc7-97ac-24c00d193168 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb1a363-09ba-44ec-a100-ae5ecb1cd635]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:18 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b43ba820-4cfe-4dc7-97ac-24c00d193168 Jul 13 20:49:18 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:18 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c8a2aa84-8917-4f03-9dd6-231c4a24e93a" returned: 0 in 0.294s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:18 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD Jul 13 20:49:18 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.837s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1651931751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6634ca78f5459e9cd379240a2b0b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:16Z,use_quota=True,user_id='e61f68c51e064fc1a49ed3e11db2bf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Creating volume 9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:18 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:18 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d 1073741824 Jul 13 20:49:18 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa107396-a075-4991-a97f-dc00a8c9250d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8a2aa84-8917-4f03-9dd6-231c4a24e93a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c45d144e-df92-41fa-bd07-5e64d5883632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:18 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Volume volume-c8a2aa84-8917-4f03-9dd6-231c4a24e93a (c8a2aa84-8917-4f03-9dd6-231c4a24e93a): created successfully Jul 13 20:49:18 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c45d144e-df92-41fa-bd07-5e64d5883632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:18 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Flow 'volume_create_manager' (55260ed6-9e63-48e7-a51e-9777fa1c7609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:18 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7869393a-4752-41af-bf4d-4452ade8db5c tempest-CreateVolumesFromSnapshotTest-2039620683 None] Created volume successfully. Jul 13 20:49:19 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b43ba820-4cfe-4dc7-97ac-24c00d193168" returned: 0 in 0.396s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-quobyte-b43ba820-4cfe-4dc7-97ac-24c00d193168" released by "delete_volume" :: held 0.958s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:19 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Created reservations ['51012a6d-305c-48b9-b93e-eef4270f1268', '6a03b28c-47ed-42b3-b4bd-f8ec4669e65e', '3774ae88-126f-4037-aefc-2eb3619e97ff', 'f03dd4a2-63ef-48e8-b5a9-a8108623ccfb'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:19 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:19 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.416s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:19 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:49:19 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:19 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:19 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d 1073741824" returned: 0 in 0.702s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:19 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d Jul 13 20:49:19 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:19 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD" returned: 1 in 0.506s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] 785f35d0-fb87-4047-84f6-8f39ba25bd66 was raw, converting to raw {{(pid=87269) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 13 20:49:19 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.345s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Deleted volume successfully. Jul 13 20:49:19 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 Jul 13 20:49:19 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c9d8f3e8-9538-4056-9925-8e97f52cc9ac tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-b43ba820-4cfe-4dc7-97ac-24c00d193168-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:19 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d" returned: 0 in 0.268s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.344s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-831535066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c5a36c2-81c2-48ad-83af-a0d15570a840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6634ca78f5459e9cd379240a2b0b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:16Z,use_quota=True,user_id='e61f68c51e064fc1a49ed3e11db2bf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Creating volume 0c5a36c2-81c2-48ad-83af-a0d15570a840 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:19 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c5a36c2-81c2-48ad-83af-a0d15570a840 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ccd9242-75bf-4fec-85ad-e5ddb4b5bfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49414d22-0443-481a-a47d-2be29d2865c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:19 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c5a36c2-81c2-48ad-83af-a0d15570a840 1073741824 Jul 13 20:49:19 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:19 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Volume volume-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d (9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d): created successfully Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49414d22-0443-481a-a47d-2be29d2865c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Flow 'volume_create_manager' (30a58c62-1b87-4001-8839-81916c19199a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-aa23af0f-03ca-49ae-bd0e-f4f182613cb4 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Created volume successfully. Jul 13 20:49:20 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03" returned: 0 in 0.409s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_785f35d0-fb87-4047-84f6-8f39ba25bd66_ic1s4k9fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:49:20 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Converted 0.00 MB image at 0.00 MB/s Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:20 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 1G Jul 13 20:49:20 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Flow 'volume_create_manager' (42e5ea87-e9ec-4a61-bcf0-9fba1d718013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348f50bb-2180-4322-aca6-e44b4df0fa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348f50bb-2180-4322-aca6-e44b4df0fa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-248143237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57c3bf3-52df-4d5c-b63e-d191390b078f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3158729eb3f247b980b8700593f4ae0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:20Z,use_quota=True,user_id='90fda355cc1346a0b03994f5aed8b741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8027f49f-5ecf-4ecb-8753-77c0cdcd622e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8027f49f-5ecf-4ecb-8753-77c0cdcd622e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59486906-357f-40dc-b694-8295af3d6bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59486906-357f-40dc-b694-8295af3d6bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b57c3bf3-52df-4d5c-b63e-d191390b078f', 'volume_name': 'volume-b57c3bf3-52df-4d5c-b63e-d191390b078f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae02a978-89c6-4135-9801-dfc0df4962bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae02a978-89c6-4135-9801-dfc0df4962bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2d2f78-c6f9-4ef6-8a32-a780e2342681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:20 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Volume b57c3bf3-52df-4d5c-b63e-d191390b078f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b57c3bf3-52df-4d5c-b63e-d191390b078f', 'volume_size': 1} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "cinder-9175bd0f-07f9-441a-bd6e-b34dd8b84d93-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-9175bd0f-07f9-441a-bd6e-b34dd8b84d93-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "cinder-quobyte-9175bd0f-07f9-441a-bd6e-b34dd8b84d93" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-quobyte-9175bd0f-07f9-441a-bd6e-b34dd8b84d93" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[305a1fed-9363-47bf-9122-d49456fae681]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9175bd0f-07f9-441a-bd6e-b34dd8b84d93 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:20 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:20 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 1G" returned: 0 in 0.371s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c5a36c2-81c2-48ad-83af-a0d15570a840 1073741824" returned: 0 in 0.570s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac80c19-3dde-4b3f-9318-ec2c1b092526]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c5a36c2-81c2-48ad-83af-a0d15570a840 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:20 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c5a36c2-81c2-48ad-83af-a0d15570a840 Jul 13 20:49:20 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:20 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9175bd0f-07f9-441a-bd6e-b34dd8b84d93 Jul 13 20:49:20 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:20 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 Jul 13 20:49:20 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:20 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c5a36c2-81c2-48ad-83af-a0d15570a840" returned: 0 in 0.281s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.833s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-315306986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b25be8-71c6-451f-8293-cd5384c19076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6634ca78f5459e9cd379240a2b0b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:17Z,use_quota=True,user_id='e61f68c51e064fc1a49ed3e11db2bf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Creating volume 61b25be8-71c6-451f-8293-cd5384c19076 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:20 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-61b25be8-71c6-451f-8293-cd5384c19076 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:20 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9175bd0f-07f9-441a-bd6e-b34dd8b84d93" returned: 0 in 0.401s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9175bd0f-07f9-441a-bd6e-b34dd8b84d93 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:20 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-61b25be8-71c6-451f-8293-cd5384c19076 1073741824 Jul 13 20:49:20 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318af96a-a47f-4cee-a950-df431c89ebe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c5a36c2-81c2-48ad-83af-a0d15570a840', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3511e6-7578-4977-9b1c-8aa0e3ba9a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:20 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9175bd0f-07f9-441a-bd6e-b34dd8b84d93 Jul 13 20:49:20 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:20 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Volume volume-0c5a36c2-81c2-48ad-83af-a0d15570a840 (0c5a36c2-81c2-48ad-83af-a0d15570a840): created successfully Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3511e6-7578-4977-9b1c-8aa0e3ba9a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Flow 'volume_create_manager' (26959960-270f-4385-b17f-d6acccbb0aca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-152364c5-a237-4bc6-8ddb-d312634888d2 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Created volume successfully. Jul 13 20:49:20 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03" returned: 0 in 0.430s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:21 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 Jul 13 20:49:21 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:21 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9175bd0f-07f9-441a-bd6e-b34dd8b84d93" returned: 0 in 0.281s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-quobyte-9175bd0f-07f9-441a-bd6e-b34dd8b84d93" released by "delete_volume" :: held 0.733s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Created reservations ['c456f36c-34c5-4ebd-8d2d-65bef5697266', '69c5e139-556b-4b80-93bc-27a8f6fedc2f', 'b009ae29-c320-4aaf-a03c-6dfad91e5798', '8a2d9cf1-0fb5-4529-9472-270e964b3532'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:21 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:21 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:21 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-61b25be8-71c6-451f-8293-cd5384c19076 1073741824" returned: 0 in 0.493s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:21 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03" returned: 1 in 0.388s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Downloaded image 785f35d0-fb87-4047-84f6-8f39ba25bd66 ((None, [{'url': 'file:///opt/stack/data/glance/images/785f35d0-fb87-4047-84f6-8f39ba25bd66', 'metadata': {}}])) to volume 5026cb9b-d27a-41b0-a386-a6b901564e03 successfully. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Temporary image 785f35d0-fb87-4047-84f6-8f39ba25bd66 for user 6372db52d9114407803e267e28709821 is deleted. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Marking volume 5026cb9b-d27a-41b0-a386-a6b901564e03 as bootable. {{(pid=87269) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Copying metadata from image 785f35d0-fb87-4047-84f6-8f39ba25bd66 to 5026cb9b-d27a-41b0-a386-a6b901564e03. {{(pid=87269) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Creating volume glance metadata for volume 5026cb9b-d27a-41b0-a386-a6b901564e03 backed by image 785f35d0-fb87-4047-84f6-8f39ba25bd66 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '785f35d0-fb87-4047-84f6-8f39ba25bd66', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9acb9ad32fbc9376ba69105e6d975703', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87269) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-61b25be8-71c6-451f-8293-cd5384c19076 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:21 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-61b25be8-71c6-451f-8293-cd5384c19076 Jul 13 20:49:21 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb4dcd49-b3f2-4fc3-80ca-3287f45e4d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5026cb9b-d27a-41b0-a386-a6b901564e03', 'volume_size': 1, 'image_id': '785f35d0-fb87-4047-84f6-8f39ba25bd66', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/785f35d0-fb87-4047-84f6-8f39ba25bd66', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9acb9ad32fbc9376ba69105e6d975703', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ac7b7e8aa135404bbf2f245d9280c347', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5196d211226f9d5cdf6dcc6bce4a4001d67b8dde8e722a61e5a70dbf3fba37a2c87faef17dc87462e5c58deed6ba72aeb3aaa17716ce280bcea922a042ca1fd4', 'id': '785f35d0-fb87-4047-84f6-8f39ba25bd66', 'created_at': datetime.datetime(2026, 7, 13, 18, 49, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 49, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/785f35d0-fb87-4047-84f6-8f39ba25bd66/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b062ba8d-4601-4830-8e29-b93c898e975c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:21 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Volume volume-5026cb9b-d27a-41b0-a386-a6b901564e03 (5026cb9b-d27a-41b0-a386-a6b901564e03): created successfully Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b062ba8d-4601-4830-8e29-b93c898e975c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Flow 'volume_create_manager' (9c4d2f83-4ca0-44d3-acd9-c11b5e95b303) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:21 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-14f36833-fdc1-4a60-aacc-e389bcd665b7 tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Created volume successfully. Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "cinder-7474e632-9171-4f55-b510-0b8be20ea630-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-7474e632-9171-4f55-b510-0b8be20ea630-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:21 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.302s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:21 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Deleted volume successfully. Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6ab11e30-cf43-4ca2-ba4b-cd1722aa7e63 tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-9175bd0f-07f9-441a-bd6e-b34dd8b84d93-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "cinder-quobyte-7474e632-9171-4f55-b510-0b8be20ea630" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-quobyte-7474e632-9171-4f55-b510-0b8be20ea630" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6924aec-88f2-482f-9dde-721df5c9eafa]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7474e632-9171-4f55-b510-0b8be20ea630 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:21 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-61b25be8-71c6-451f-8293-cd5384c19076" returned: 0 in 0.344s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.247s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1828089462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd9aa47-60bd-4c39-bed2-dd35c265372f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6634ca78f5459e9cd379240a2b0b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:17Z,use_quota=True,user_id='e61f68c51e064fc1a49ed3e11db2bf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Creating volume 2bd9aa47-60bd-4c39-bed2-dd35c265372f {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:21 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2bd9aa47-60bd-4c39-bed2-dd35c265372f 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:21 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2bd9aa47-60bd-4c39-bed2-dd35c265372f 1073741824 Jul 13 20:49:21 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc2eec3-1c12-4115-8f58-d3c372d4de5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b25be8-71c6-451f-8293-cd5384c19076', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79481636-ce43-433c-9e3b-76134930c8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Acquiring lock "cinder-5026cb9b-d27a-41b0-a386-a6b901564e03-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:21 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Volume volume-61b25be8-71c6-451f-8293-cd5384c19076 (61b25be8-71c6-451f-8293-cd5384c19076): created successfully Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79481636-ce43-433c-9e3b-76134930c8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Flow 'volume_create_manager' (3661ee18-a84c-48dd-a761-12f9f6b14643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Lock "cinder-5026cb9b-d27a-41b0-a386-a6b901564e03-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:21 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0a0ba8ba-29f4-4ae4-ac45-59c0f87a7691 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Created volume successfully. Jul 13 20:49:21 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7474e632-9171-4f55-b510-0b8be20ea630 Jul 13 20:49:21 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Acquiring lock "cinder-quobyte-5026cb9b-d27a-41b0-a386-a6b901564e03" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Lock "cinder-quobyte-5026cb9b-d27a-41b0-a386-a6b901564e03" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6eaf489-8ffc-4f91-81e7-93e107588531]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:22 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 Jul 13 20:49:22 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:22 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7474e632-9171-4f55-b510-0b8be20ea630" returned: 0 in 0.432s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7474e632-9171-4f55-b510-0b8be20ea630 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:22 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7474e632-9171-4f55-b510-0b8be20ea630 Jul 13 20:49:22 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:22 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2bd9aa47-60bd-4c39-bed2-dd35c265372f 1073741824" returned: 0 in 0.516s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2bd9aa47-60bd-4c39-bed2-dd35c265372f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:22 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2bd9aa47-60bd-4c39-bed2-dd35c265372f Jul 13 20:49:22 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:22 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03" returned: 0 in 0.419s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:22 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7474e632-9171-4f55-b510-0b8be20ea630" returned: 0 in 0.285s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-quobyte-7474e632-9171-4f55-b510-0b8be20ea630" released by "delete_volume" :: held 0.781s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Created reservations ['963b1e3d-78a0-4a94-95b6-4ca5fde2471b', '8b27e07b-b9cc-4ddb-9577-70ac3d47298a', '5a6098b5-79d8-4bab-b623-9825792ec638', '25795b74-67bc-4379-8ec4-eeefd4615b21'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:22 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 Jul 13 20:49:22 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:22 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2bd9aa47-60bd-4c39-bed2-dd35c265372f" returned: 0 in 0.283s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.305s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-248143237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57c3bf3-52df-4d5c-b63e-d191390b078f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3158729eb3f247b980b8700593f4ae0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:20Z,use_quota=True,user_id='90fda355cc1346a0b03994f5aed8b741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Creating volume b57c3bf3-52df-4d5c-b63e-d191390b078f {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:22 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:22 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:22 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5792d9b5-7aa6-45d7-8cd2-c7ea93a12da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bd9aa47-60bd-4c39-bed2-dd35c265372f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:22 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f 1073741824 Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (effa4fef-3f05-4b58-a94b-1bef727f8428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:22 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:22 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Volume volume-2bd9aa47-60bd-4c39-bed2-dd35c265372f (2bd9aa47-60bd-4c39-bed2-dd35c265372f): created successfully Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (effa4fef-3f05-4b58-a94b-1bef727f8428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Flow 'volume_create_manager' (2569c319-ec95-4d5f-b966-40959b1495c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9f35e9e2-7e93-4f1c-8923-b60482c61527 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Created volume successfully. Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "cinder-0bc5efcd-6d45-4941-a2b6-85443de67e38-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:22 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03" returned: 1 in 0.406s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-0bc5efcd-6d45-4941-a2b6-85443de67e38-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:22 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03 Jul 13 20:49:22 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "cinder-quobyte-0bc5efcd-6d45-4941-a2b6-85443de67e38" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-quobyte-0bc5efcd-6d45-4941-a2b6-85443de67e38" acquired by "delete_volume" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7f311d-a462-4c61-a77a-3b222c775d63]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0bc5efcd-6d45-4941-a2b6-85443de67e38 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:22 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.440s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Deleted volume successfully. Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-15b729e6-c05f-4aa0-9877-66f551dfb40c tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-7474e632-9171-4f55-b510-0b8be20ea630-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "cinder-2bd9aa47-60bd-4c39-bed2-dd35c265372f-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-2bd9aa47-60bd-4c39-bed2-dd35c265372f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "cinder-quobyte-2bd9aa47-60bd-4c39-bed2-dd35c265372f" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:23 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0bc5efcd-6d45-4941-a2b6-85443de67e38 Jul 13 20:49:23 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-quobyte-2bd9aa47-60bd-4c39-bed2-dd35c265372f" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc1a52d-c233-4cff-86ef-050afa782aff]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2bd9aa47-60bd-4c39-bed2-dd35c265372f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:23 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5026cb9b-d27a-41b0-a386-a6b901564e03" returned: 0 in 0.452s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Lock "cinder-quobyte-5026cb9b-d27a-41b0-a386-a6b901564e03" released by "delete_volume" :: held 1.354s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:23 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f 1073741824" returned: 0 in 0.685s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:23 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2bd9aa47-60bd-4c39-bed2-dd35c265372f Jul 13 20:49:23 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Created reservations ['9484fb0c-c3f8-4ffd-b9f5-559b39bbd6a7', '5eaee417-2b0a-4520-8285-ff2da4d5732f', 'f2e19242-3a5d-49c7-8400-f98aaa149abb', '82c3fce0-c126-49ed-9939-8884e5163cf9'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:23 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f Jul 13 20:49:23 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:23 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0bc5efcd-6d45-4941-a2b6-85443de67e38" returned: 0 in 0.562s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0bc5efcd-6d45-4941-a2b6-85443de67e38 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:23 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:23 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:23 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0bc5efcd-6d45-4941-a2b6-85443de67e38 Jul 13 20:49:23 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:23 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:23 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f" returned: 0 in 0.291s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2bd9aa47-60bd-4c39-bed2-dd35c265372f" returned: 0 in 0.477s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2bd9aa47-60bd-4c39-bed2-dd35c265372f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2d2f78-c6f9-4ef6-8a32-a780e2342681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b57c3bf3-52df-4d5c-b63e-d191390b078f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fb84d1-1713-4cd7-a6a2-30717a9a3dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:23 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2bd9aa47-60bd-4c39-bed2-dd35c265372f Jul 13 20:49:23 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:23 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Volume volume-b57c3bf3-52df-4d5c-b63e-d191390b078f (b57c3bf3-52df-4d5c-b63e-d191390b078f): created successfully Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fb84d1-1713-4cd7-a6a2-30717a9a3dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Flow 'volume_create_manager' (42e5ea87-e9ec-4a61-bcf0-9fba1d718013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:23 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1279c4dc-1c62-4e47-8b8d-1f6b79f237ae tempest-VolumeDependencyTests-2128252877 None] Created volume successfully. Jul 13 20:49:23 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.284s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:23 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0bc5efcd-6d45-4941-a2b6-85443de67e38" returned: 0 in 0.277s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:23 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Deleted volume successfully. Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-quobyte-0bc5efcd-6d45-4941-a2b6-85443de67e38" released by "delete_volume" :: held 0.920s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-da64a6eb-0fea-47ec-bab3-1ade2719145e tempest-VolumeAndVolumeTypeFromImageTest-1505072861 None] Lock "cinder-5026cb9b-d27a-41b0-a386-a6b901564e03-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Created reservations ['a785634b-5507-4653-8343-f408ee6340b3', 'ac3dbcea-3823-4317-b00b-3cc03ff9c045', '4bb9e191-9574-4b30-bd00-05130bb301be', '1c43acff-dd0a-47d5-804f-dd5058a451bd'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:23 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2bd9aa47-60bd-4c39-bed2-dd35c265372f" returned: 0 in 0.284s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-quobyte-2bd9aa47-60bd-4c39-bed2-dd35c265372f" released by "delete_volume" :: held 0.807s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "cinder-1d35e9dd-4089-40e5-8acf-9f69fd924508-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:23 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:23 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-1d35e9dd-4089-40e5-8acf-9f69fd924508-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Created reservations ['7b74e8fb-27b7-4a10-98d8-9d4b9eb4963d', 'bcf691f1-f49a-44ee-85bd-be0ce6e0da61', '58474973-82cf-4ce5-89d7-05722d308bfe', 'fb6cca09-c5dd-4344-a287-0c8d15c3d29f'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "cinder-quobyte-1d35e9dd-4089-40e5-8acf-9f69fd924508" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-quobyte-1d35e9dd-4089-40e5-8acf-9f69fd924508" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afa3b15-9197-4772-a8fe-5d4f49a3c6f0]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1d35e9dd-4089-40e5-8acf-9f69fd924508 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "cinder-61b25be8-71c6-451f-8293-cd5384c19076-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-61b25be8-71c6-451f-8293-cd5384c19076-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:24 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:24 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "cinder-quobyte-61b25be8-71c6-451f-8293-cd5384c19076" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:24 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1d35e9dd-4089-40e5-8acf-9f69fd924508 Jul 13 20:49:24 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:24 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.414s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-quobyte-61b25be8-71c6-451f-8293-cd5384c19076" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:24 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Deleted volume successfully. Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13dcb8b-2445-43c1-90f7-53381ee283e8]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-61b25be8-71c6-451f-8293-cd5384c19076 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-140880e5-296a-47a4-ae5d-2bdf8ed2bdbb tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-0bc5efcd-6d45-4941-a2b6-85443de67e38-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:24 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-61b25be8-71c6-451f-8293-cd5384c19076 Jul 13 20:49:24 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:24 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:24 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.506s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1d35e9dd-4089-40e5-8acf-9f69fd924508" returned: 0 in 0.574s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1d35e9dd-4089-40e5-8acf-9f69fd924508 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:24 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Deleted volume successfully. Jul 13 20:49:24 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1d35e9dd-4089-40e5-8acf-9f69fd924508 Jul 13 20:49:24 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b95b3c58-06f1-4519-b327-afa90e6404c9 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-2bd9aa47-60bd-4c39-bed2-dd35c265372f-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-54d65f26-291a-4ded-9d6a-3db9d41f618a tempest-VolumeDependencyTests-2128252877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-54d65f26-291a-4ded-9d6a-3db9d41f618a tempest-VolumeDependencyTests-2128252877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-54d65f26-291a-4ded-9d6a-3db9d41f618a tempest-VolumeDependencyTests-2128252877 None] Creating offline snapshot 375a1987-9585-4dda-b452-216c6b0c3bc8 of volume b57c3bf3-52df-4d5c-b63e-d191390b078f {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[430d2791-dece-4d17-9088-b124a70c0679]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d65f26-291a-4ded-9d6a-3db9d41f618a tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:24 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-61b25be8-71c6-451f-8293-cd5384c19076" returned: 0 in 0.554s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-61b25be8-71c6-451f-8293-cd5384c19076 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:24 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f Jul 13 20:49:24 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:24 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-61b25be8-71c6-451f-8293-cd5384c19076 Jul 13 20:49:24 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:24 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-1d35e9dd-4089-40e5-8acf-9f69fd924508" returned: 0 in 0.307s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-quobyte-1d35e9dd-4089-40e5-8acf-9f69fd924508" released by "delete_volume" :: held 0.965s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Created reservations ['12b1241a-12ca-48cb-add0-17e12073a6c6', '8b3ac735-1441-4a66-ab4b-0694099a6579', '19206e93-9e1d-48ad-b79e-ebf163a2cb16', '9c9509ea-a7a8-40db-9ae7-c0446ecf2efb'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:25 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:25 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:25 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-61b25be8-71c6-451f-8293-cd5384c19076" returned: 0 in 0.329s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-quobyte-61b25be8-71c6-451f-8293-cd5384c19076" released by "delete_volume" :: held 0.941s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:25 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d65f26-291a-4ded-9d6a-3db9d41f618a tempest-VolumeDependencyTests-2128252877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f" returned: 0 in 0.486s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d65f26-291a-4ded-9d6a-3db9d41f618a tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:25 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8 1G Jul 13 20:49:25 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Created reservations ['7db85fd4-1cf8-4b1a-b2cc-edd6ed7fe6cf', 'bbc8d89c-e1d8-43bd-8c73-d187f457e583', '0a4ac077-9ad6-49db-8a72-24a398fd125e', '3b54181d-f3f3-4e98-8384-2e36e6cd2764'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:25 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:25 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:25 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.306s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Deleted volume successfully. Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e96bdca4-6902-42dd-b627-c33a1bbc554e tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-1d35e9dd-4089-40e5-8acf-9f69fd924508-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:25 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.321s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Deleted volume successfully. Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4fd47fa2-50f8-422d-bcd6-5817fa5e9071 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-61b25be8-71c6-451f-8293-cd5384c19076-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:25 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d65f26-291a-4ded-9d6a-3db9d41f618a tempest-VolumeDependencyTests-2128252877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8 1G" returned: 0 in 0.537s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d65f26-291a-4ded-9d6a-3db9d41f618a tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b57c3bf3-52df-4d5c-b63e-d191390b078f -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:25 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b57c3bf3-52df-4d5c-b63e-d191390b078f -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8 Jul 13 20:49:25 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:26 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d65f26-291a-4ded-9d6a-3db9d41f618a tempest-VolumeDependencyTests-2128252877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b57c3bf3-52df-4d5c-b63e-d191390b078f -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8" returned: 0 in 0.313s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:26 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-54d65f26-291a-4ded-9d6a-3db9d41f618a tempest-VolumeDependencyTests-2128252877 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8 is being set with open permissions: ugo+rw Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d65f26-291a-4ded-9d6a-3db9d41f618a tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:26 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8 Jul 13 20:49:26 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "cinder-b252cccc-88e3-48d9-9ace-467b02c1d51e-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-b252cccc-88e3-48d9-9ace-467b02c1d51e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "cinder-quobyte-b252cccc-88e3-48d9-9ace-467b02c1d51e" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-quobyte-b252cccc-88e3-48d9-9ace-467b02c1d51e" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e713152-07ca-48a2-a62f-ccdb38e0e539]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b252cccc-88e3-48d9-9ace-467b02c1d51e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "cinder-0c5a36c2-81c2-48ad-83af-a0d15570a840-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:26 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d65f26-291a-4ded-9d6a-3db9d41f618a tempest-VolumeDependencyTests-2128252877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8" returned: 0 in 0.349s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-0c5a36c2-81c2-48ad-83af-a0d15570a840-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:26 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b252cccc-88e3-48d9-9ace-467b02c1d51e Jul 13 20:49:26 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d65f26-291a-4ded-9d6a-3db9d41f618a tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "cinder-quobyte-0c5a36c2-81c2-48ad-83af-a0d15570a840" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:26 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.info Jul 13 20:49:26 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-quobyte-0c5a36c2-81c2-48ad-83af-a0d15570a840" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f18f944-bc14-49da-9359-1c4c61c33225]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c5a36c2-81c2-48ad-83af-a0d15570a840 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:26 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c5a36c2-81c2-48ad-83af-a0d15570a840 Jul 13 20:49:26 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:26 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b252cccc-88e3-48d9-9ace-467b02c1d51e" returned: 0 in 0.496s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b252cccc-88e3-48d9-9ace-467b02c1d51e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:26 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d65f26-291a-4ded-9d6a-3db9d41f618a tempest-VolumeDependencyTests-2128252877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.info" returned: 0 in 0.362s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:26 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-54d65f26-291a-4ded-9d6a-3db9d41f618a tempest-VolumeDependencyTests-2128252877 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.info is being set with open permissions: ugo+rw Jul 13 20:49:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d65f26-291a-4ded-9d6a-3db9d41f618a tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:26 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b252cccc-88e3-48d9-9ace-467b02c1d51e Jul 13 20:49:26 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:26 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.info Jul 13 20:49:26 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:27 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c5a36c2-81c2-48ad-83af-a0d15570a840" returned: 0 in 0.495s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c5a36c2-81c2-48ad-83af-a0d15570a840 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:27 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c5a36c2-81c2-48ad-83af-a0d15570a840 Jul 13 20:49:27 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:27 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b252cccc-88e3-48d9-9ace-467b02c1d51e" returned: 0 in 0.313s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:27 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d65f26-291a-4ded-9d6a-3db9d41f618a tempest-VolumeDependencyTests-2128252877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.info" returned: 0 in 0.309s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-54d65f26-291a-4ded-9d6a-3db9d41f618a tempest-VolumeDependencyTests-2128252877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.500s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-quobyte-b252cccc-88e3-48d9-9ace-467b02c1d51e" released by "delete_volume" :: held 0.898s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:27 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-54d65f26-291a-4ded-9d6a-3db9d41f618a tempest-VolumeDependencyTests-2128252877 None] Create snapshot completed successfully Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Created reservations ['1670d3bb-3562-4c08-b594-b91e6fe7caa1', '1cfbbc32-8a13-40fb-a191-93c1e9c0114c', '75d544a7-1e64-4128-9dad-56941d84b373', '2bc01c47-9f4d-460a-bf8a-aeb05f26a17a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:27 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0c5a36c2-81c2-48ad-83af-a0d15570a840" returned: 0 in 0.386s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:27 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:27 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-quobyte-0c5a36c2-81c2-48ad-83af-a0d15570a840" released by "delete_volume" :: held 0.934s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] Created reservations ['cad0609b-69bc-4fd4-af0b-7ae1ec929213', '49d326b7-2201-4bd9-9df8-671fc8cf622a', '779ba9f0-0bf6-4e50-b4c5-4d1f308be7f1', '5c215152-7cb1-4aeb-b6af-c63164ad0a3c'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:27 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:27 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:27 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.291s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:27 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Deleted volume successfully. Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-215f82c4-130e-42c6-b9bd-483b5a236efa tempest-CreateVolumesFromSourceVolumeTest-1806447631 None] Lock "cinder-b252cccc-88e3-48d9-9ace-467b02c1d51e-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:27 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.260s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:27 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] Deleted volume successfully. Jul 13 20:49:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0cb010d4-f2a5-48ca-b964-fd9b8c22ca9b tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-0c5a36c2-81c2-48ad-83af-a0d15570a840-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Flow 'volume_create_manager' (ac7858b6-a5f9-4229-9a84-5337fac6bde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c21a2b4-aa9e-419e-bdc6-33343fc4a8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c21a2b4-aa9e-419e-bdc6-33343fc4a8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-370973367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29e479aa-d62e-451a-8266-b901a5649694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3158729eb3f247b980b8700593f4ae0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=375a1987-9585-4dda-b452-216c6b0c3bc8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:28Z,use_quota=True,user_id='90fda355cc1346a0b03994f5aed8b741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09215bde-9add-4d38-9d4a-133932ea926c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09215bde-9add-4d38-9d4a-133932ea926c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9fbae3-699f-4cb7-b122-2bd0374ead49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9fbae3-699f-4cb7-b122-2bd0374ead49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '29e479aa-d62e-451a-8266-b901a5649694', 'volume_name': 'volume-29e479aa-d62e-451a-8266-b901a5649694', 'volume_size': 1, 'snapshot_id': '375a1987-9585-4dda-b452-216c6b0c3bc8'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b53448-e456-40e3-af2a-82a4f5e18a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b53448-e456-40e3-af2a-82a4f5e18a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8caa9c1-3a2e-4017-9e92-02bdd719733d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:28 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Volume 29e479aa-d62e-451a-8266-b901a5649694: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-29e479aa-d62e-451a-8266-b901a5649694', 'volume_size': 1, 'snapshot_id': '375a1987-9585-4dda-b452-216c6b0c3bc8'} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Acquiring lock "cinder-quobyte-375a1987-9585-4dda-b452-216c6b0c3bc8-29e479aa-d62e-451a-8266-b901a5649694" by "_create_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Lock "cinder-quobyte-375a1987-9585-4dda-b452-216c6b0c3bc8-29e479aa-d62e-451a-8266-b901a5649694" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Creating volume 29e479aa-d62e-451a-8266-b901a5649694 from snapshot 375a1987-9585-4dda-b452-216c6b0c3bc8 {{(pid=87269) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Acquiring lock "cinder-quobyte-29e479aa-d62e-451a-8266-b901a5649694" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Lock "cinder-quobyte-29e479aa-d62e-451a-8266-b901a5649694" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] snapshot: 375a1987-9585-4dda-b452-216c6b0c3bc8, volume: 29e479aa-d62e-451a-8266-b901a5649694, {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed84c83d-c3c8-4a33-8109-102e39585229]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "cinder-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:28 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8 Jul 13 20:49:28 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "cinder-quobyte-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-quobyte-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdffb61-fbf7-44c8-93e3-49d5dbec3e69]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:29 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d Jul 13 20:49:29 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:29 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8" returned: 0 in 0.459s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b57c3bf3-52df-4d5c-b63e-d191390b078f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f3142a-1ef4-4d80-996b-2e2a4508cead]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:29 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f Jul 13 20:49:29 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:29 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d" returned: 0 in 0.493s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:29 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d Jul 13 20:49:29 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:29 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f" returned: 0 in 0.523s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Path /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-29e479aa-d62e-451a-8266-b901a5649694 not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-29e479aa-d62e-451a-8266-b901a5649694 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:29 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-29e479aa-d62e-451a-8266-b901a5649694 Jul 13 20:49:29 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:29 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d" returned: 0 in 0.324s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-quobyte-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d" released by "delete_volume" :: held 0.876s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Created reservations ['f1705a25-255e-4360-a182-1836b81136dd', '9558d31c-1d48-433d-9986-fa3a7d345752', 'ef6a2ad7-4033-47e8-b52a-ff82dce961ba', '077db6c0-f2d5-4819-85f2-c7ed7c741a26'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:29 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:29 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "cinder-c8a2aa84-8917-4f03-9dd6-231c4a24e93a-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-c8a2aa84-8917-4f03-9dd6-231c4a24e93a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "cinder-quobyte-c8a2aa84-8917-4f03-9dd6-231c4a24e93a" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-quobyte-c8a2aa84-8917-4f03-9dd6-231c4a24e93a" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:30 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc32d323-cd8e-4515-9298-40a0f75ccc29]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c8a2aa84-8917-4f03-9dd6-231c4a24e93a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:30 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c8a2aa84-8917-4f03-9dd6-231c4a24e93a Jul 13 20:49:30 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:30 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.460s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:30 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Deleted volume successfully. Jul 13 20:49:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f6d2084-928f-428d-8472-26a30cdb4603 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-9dcbe090-3f0c-4fb5-a874-9c3f9095ef2d-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:31 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c8a2aa84-8917-4f03-9dd6-231c4a24e93a" returned: 0 in 0.983s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c8a2aa84-8917-4f03-9dd6-231c4a24e93a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:31 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c8a2aa84-8917-4f03-9dd6-231c4a24e93a Jul 13 20:49:31 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:31 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-c8a2aa84-8917-4f03-9dd6-231c4a24e93a" returned: 0 in 0.562s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-quobyte-c8a2aa84-8917-4f03-9dd6-231c4a24e93a" released by "delete_volume" :: held 1.644s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:31 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Created reservations ['01f50e3a-69a5-4112-8659-bedd0f12a821', 'e5f1bb37-8548-4999-b4fe-93c17602cfce', '4604d959-7067-4baf-90c7-c5a8d6f6378e', '29f5cc06-dd08-4adb-b167-67942e1a46a1'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:32 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:32 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:32 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "cinder-9b3fd5fe-2474-4467-bac7-6920629e702e-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.429s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:32 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Deleted volume successfully. Jul 13 20:49:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-9b3fd5fe-2474-4467-bac7-6920629e702e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "cinder-quobyte-b8f43123-d17c-4a66-afaa-848c9343b357" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-quobyte-b8f43123-d17c-4a66-afaa-848c9343b357" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "cinder-quobyte-9b3fd5fe-2474-4467-bac7-6920629e702e" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e002593b-391c-4183-bd0a-7c7cbfdc0d41 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-c8a2aa84-8917-4f03-9dd6-231c4a24e93a-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-quobyte-9b3fd5fe-2474-4467-bac7-6920629e702e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Deleting offline snapshot 9b3fd5fe-2474-4467-bac7-6920629e702e of volume b8f43123-d17c-4a66-afaa-848c9343b357 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:49:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] snapshot_file for this snap is: volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:49:32 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[58075fb9-0833-49f2-ade7-c45ef7a95802]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:33 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e Jul 13 20:49:33 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:34 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e" returned: 0 in 1.147s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8f43123-d17c-4a66-afaa-848c9343b357(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:49:34 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b694477-f9f4-44b0-9a44-2f6585356b46]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:34 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357 Jul 13 20:49:34 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:35 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357" returned: 0 in 1.117s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:35 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e Jul 13 20:49:35 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:35 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Flow 'volume_create_manager' (35adf543-3d6a-4882-8ec2-10837ddf595f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e077608e-d80e-4500-8456-58de63f79298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e077608e-d80e-4500-8456-58de63f79298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1691914-9f30-4cf3-a377-29a961b8c76f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27121a0bd7564fc0b7b87a48ba5c5fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:36Z,use_quota=True,user_id='82887bf7050c481e8dc78659beec0c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68887cb5-0726-4c3e-8c18-165b55103c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68887cb5-0726-4c3e-8c18-165b55103c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1077a479-8b4c-4a34-8883-8f7e2788fdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1077a479-8b4c-4a34-8883-8f7e2788fdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1691914-9f30-4cf3-a377-29a961b8c76f', 'volume_name': 'volume-f1691914-9f30-4cf3-a377-29a961b8c76f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bbfd5e8-5de0-422d-ad3b-f9702753fd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bbfd5e8-5de0-422d-ad3b-f9702753fd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e13dfd-1619-48c7-aaf9-211f4af9e909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:35 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Volume f1691914-9f30-4cf3-a377-29a961b8c76f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1691914-9f30-4cf3-a377-29a961b8c76f', 'volume_size': 1} Jul 13 20:49:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:35 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-29e479aa-d62e-451a-8266-b901a5649694" returned: 0 in 6.100s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:35 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c7f225-1b49-4bc6-96db-d0408f2b0401]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:35 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e" returned: 0 in 0.616s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:35 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e Jul 13 20:49:35 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:35 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f Jul 13 20:49:35 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:36 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357.9b3fd5fe-2474-4467-bac7-6920629e702e" returned: 0 in 0.299s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-quobyte-9b3fd5fe-2474-4467-bac7-6920629e702e" released by "_delete_snapshot" :: held 3.426s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-quobyte-b8f43123-d17c-4a66-afaa-848c9343b357" released by "delete_snapshot" :: held 3.462s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Created reservations ['210bef8d-0cf6-4d7a-9028-5012e890881e', '4e3d1583-6005-4526-86f7-efb702c524ff', '3c1bc143-04eb-44c7-ab29-d6740aae4e3e', 'bc72f970-cbf9-4032-a6b5-ba7acc652b98'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:36 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Delete snapshot completed successfully. Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2b33cd13-ffb7-45d3-abb6-88084a32a078 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-9b3fd5fe-2474-4467-bac7-6920629e702e-delete_snapshot" released by "delete_snapshot" :: held 3.638s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:36 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f" returned: 0 in 0.574s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f, size 1024.00 MB, duration 6.10 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-29e479aa-d62e-451a-8266-b901a5649694 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:49:36 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Converted 1024.00 MB image at 167.84 MB/s Jul 13 20:49:36 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-29e479aa-d62e-451a-8266-b901a5649694 is being set with open permissions: ugo+rw Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-29e479aa-d62e-451a-8266-b901a5649694 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:36 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-29e479aa-d62e-451a-8266-b901a5649694 Jul 13 20:49:36 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:36 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-29e479aa-d62e-451a-8266-b901a5649694" returned: 0 in 0.241s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Lock "cinder-quobyte-29e479aa-d62e-451a-8266-b901a5649694" released by "_copy_volume_from_snapshot" :: held 8.016s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Lock "cinder-quobyte-375a1987-9585-4dda-b452-216c6b0c3bc8-29e479aa-d62e-451a-8266-b901a5649694" released by "_create_volume_from_snapshot" :: held 8.051s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.073s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.853s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1691914-9f30-4cf3-a377-29a961b8c76f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27121a0bd7564fc0b7b87a48ba5c5fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:36Z,use_quota=True,user_id='82887bf7050c481e8dc78659beec0c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Creating volume f1691914-9f30-4cf3-a377-29a961b8c76f {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:36 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1691914-9f30-4cf3-a377-29a961b8c76f 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:36 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1691914-9f30-4cf3-a377-29a961b8c76f 1073741824 Jul 13 20:49:36 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8caa9c1-3a2e-4017-9e92-02bdd719733d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29e479aa-d62e-451a-8266-b901a5649694', 'volume_size': 1, 'snapshot_id': '375a1987-9585-4dda-b452-216c6b0c3bc8'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e68c0d-276f-473d-86c2-256e086d0bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:36 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Volume volume-29e479aa-d62e-451a-8266-b901a5649694 (29e479aa-d62e-451a-8266-b901a5649694): created successfully Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e68c0d-276f-473d-86c2-256e086d0bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Flow 'volume_create_manager' (ac7858b6-a5f9-4229-9a84-5337fac6bde8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:36 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5e867677-2288-42dd-bc3f-878745e73080 tempest-VolumeDependencyTests-2128252877 None] Created volume successfully. Jul 13 20:49:37 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1691914-9f30-4cf3-a377-29a961b8c76f 1073741824" returned: 0 in 0.407s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1691914-9f30-4cf3-a377-29a961b8c76f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:37 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1691914-9f30-4cf3-a377-29a961b8c76f Jul 13 20:49:37 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "cinder-b8f43123-d17c-4a66-afaa-848c9343b357-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-b8f43123-d17c-4a66-afaa-848c9343b357-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "cinder-quobyte-b8f43123-d17c-4a66-afaa-848c9343b357" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-quobyte-b8f43123-d17c-4a66-afaa-848c9343b357" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:37 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1691914-9f30-4cf3-a377-29a961b8c76f" returned: 0 in 0.272s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e13dfd-1619-48c7-aaf9-211f4af9e909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1691914-9f30-4cf3-a377-29a961b8c76f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cdbc0d8-aaa8-46be-a370-e6dc35f1fd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ec9b3e-0c24-4e28-99d7-4f2fd85ffb72]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:37 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Volume volume-f1691914-9f30-4cf3-a377-29a961b8c76f (f1691914-9f30-4cf3-a377-29a961b8c76f): created successfully Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cdbc0d8-aaa8-46be-a370-e6dc35f1fd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Flow 'volume_create_manager' (35adf543-3d6a-4882-8ec2-10837ddf595f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:37 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e2c647f7-29fd-4c36-bfe2-f407e1b1a0ef tempest-CinderUnicodeTest-217711761 None] Created volume successfully. Jul 13 20:49:37 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357 Jul 13 20:49:37 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] Acquiring lock "cinder-375a1987-9585-4dda-b452-216c6b0c3bc8-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] Lock "cinder-375a1987-9585-4dda-b452-216c6b0c3bc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] Acquiring lock "cinder-quobyte-b57c3bf3-52df-4d5c-b63e-d191390b078f" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] Lock "cinder-quobyte-b57c3bf3-52df-4d5c-b63e-d191390b078f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] Acquiring lock "cinder-quobyte-375a1987-9585-4dda-b452-216c6b0c3bc8" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] Lock "cinder-quobyte-375a1987-9585-4dda-b452-216c6b0c3bc8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] Deleting offline snapshot 375a1987-9585-4dda-b452-216c6b0c3bc8 of volume b57c3bf3-52df-4d5c-b63e-d191390b078f {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] snapshot_file for this snap is: volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f15258-659c-4741-8e08-e0461707dc0a]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:37 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:37 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8 Jul 13 20:49:37 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357" returned: 0 in 0.429s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:37 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357 Jul 13 20:49:37 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:38 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:38 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b8f43123-d17c-4a66-afaa-848c9343b357" returned: 0 in 0.277s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8" returned: 0 in 0.402s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b57c3bf3-52df-4d5c-b63e-d191390b078f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:49:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-quobyte-b8f43123-d17c-4a66-afaa-848c9343b357" released by "delete_volume" :: held 0.805s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:38 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[106cdc06-3412-41fe-ba58-10caac85a49d]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:38 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Created reservations ['d2623351-20d4-4e83-8e16-62707fb54219', '4d6922ae-d7db-45d5-a1d1-a59d8497d157', '593151c7-8290-4616-959f-ee90eddbb980', '29e0dc59-9456-4a4d-8d1f-4bc45a829397'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:38 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f Jul 13 20:49:38 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:38 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:38 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:38 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f" returned: 0 in 0.493s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:38 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.382s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:38 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:38 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8 Jul 13 20:49:38 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Deleted volume successfully. Jul 13 20:49:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ff311ff-ca15-485f-b5c1-33413ca0f373 tempest-CreateVolumesFromSnapshotTest-2039620683 None] Lock "cinder-b8f43123-d17c-4a66-afaa-848c9343b357-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:39 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8" returned: 0 in 0.506s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:39 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8 Jul 13 20:49:39 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Flow 'volume_create_manager' (b6139330-1c78-4e5c-b21e-b3768d4ddcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d2599c-9eb8-478e-871e-2d11f7be2e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d2599c-9eb8-478e-871e-2d11f7be2e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1689055444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7155ef-67b3-409c-92b2-b6b4d63279c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27121a0bd7564fc0b7b87a48ba5c5fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:39Z,use_quota=True,user_id='82887bf7050c481e8dc78659beec0c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def6112e-b161-418b-aaf3-0eee5547bfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def6112e-b161-418b-aaf3-0eee5547bfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d578bbf2-a0d1-477e-a976-5be5a05e97be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d578bbf2-a0d1-477e-a976-5be5a05e97be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d7155ef-67b3-409c-92b2-b6b4d63279c1', 'volume_name': 'volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5fb8147-6a48-4fb0-a0d5-ee0446b63af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5fb8147-6a48-4fb0-a0d5-ee0446b63af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b88857-5687-4196-bb6f-ef09a15d2f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:39 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Volume 5d7155ef-67b3-409c-92b2-b6b4d63279c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1', 'volume_size': 1} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1689055444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7155ef-67b3-409c-92b2-b6b4d63279c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27121a0bd7564fc0b7b87a48ba5c5fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:39Z,use_quota=True,user_id='82887bf7050c481e8dc78659beec0c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Creating volume 5d7155ef-67b3-409c-92b2-b6b4d63279c1 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:39 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:39 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1 1073741824 Jul 13 20:49:39 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:39 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f.375a1987-9585-4dda-b452-216c6b0c3bc8" returned: 0 in 0.451s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] Lock "cinder-quobyte-375a1987-9585-4dda-b452-216c6b0c3bc8" released by "_delete_snapshot" :: held 1.975s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] Lock "cinder-quobyte-b57c3bf3-52df-4d5c-b63e-d191390b078f" released by "delete_snapshot" :: held 2.002s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] Created reservations ['f8d3ff5d-72c2-442c-b607-ed68acc6f1d2', '5d7ea082-f954-4dda-b2dc-5043c09217a2', '40b7ce6c-ec01-417a-910d-11f3e5f34952', '09693ef2-8059-4994-ad9b-5cb6958f2973'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] Delete snapshot completed successfully. Jul 13 20:49:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-aebb0962-35a0-4faf-a070-ee31507b0c44 tempest-VolumeDependencyTests-2128252877 None] Lock "cinder-375a1987-9585-4dda-b452-216c6b0c3bc8-delete_snapshot" released by "delete_snapshot" :: held 2.197s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:40 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1 1073741824" returned: 0 in 0.556s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:40 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1 Jul 13 20:49:40 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:40 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1" returned: 0 in 0.338s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b88857-5687-4196-bb6f-ef09a15d2f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280e20f2-83cc-467e-bba6-b1f3539ffce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:40 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Volume volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1 (5d7155ef-67b3-409c-92b2-b6b4d63279c1): created successfully Jul 13 20:49:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280e20f2-83cc-467e-bba6-b1f3539ffce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Flow 'volume_create_manager' (b6139330-1c78-4e5c-b21e-b3768d4ddcae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:40 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-78dfc9b9-5a63-40d5-9756-155a87907d15 tempest-CinderUnicodeTest-217711761 None] Created volume successfully. Jul 13 20:49:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] Acquiring lock "cinder-b57c3bf3-52df-4d5c-b63e-d191390b078f-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] Lock "cinder-b57c3bf3-52df-4d5c-b63e-d191390b078f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] Acquiring lock "cinder-quobyte-b57c3bf3-52df-4d5c-b63e-d191390b078f" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] Lock "cinder-quobyte-b57c3bf3-52df-4d5c-b63e-d191390b078f" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:41 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f88fc4-bb8f-43fd-aa98-43695043c6bc]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:41 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f Jul 13 20:49:41 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:41 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f" returned: 0 in 0.420s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:41 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f Jul 13 20:49:41 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:41 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-569e25e5-4eb9-4ad3-b938-1f5b04219912 tempest-CinderUnicodeTest-217711761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-569e25e5-4eb9-4ad3-b938-1f5b04219912 tempest-CinderUnicodeTest-217711761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b57c3bf3-52df-4d5c-b63e-d191390b078f" returned: 0 in 0.329s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] Lock "cinder-quobyte-b57c3bf3-52df-4d5c-b63e-d191390b078f" released by "delete_volume" :: held 0.829s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-569e25e5-4eb9-4ad3-b938-1f5b04219912 tempest-CinderUnicodeTest-217711761 None] Creating offline snapshot a19c0548-daaa-40d8-b3a5-8f618828d638 of volume 5d7155ef-67b3-409c-92b2-b6b4d63279c1 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:49:41 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[236e3fa5-20ed-45c3-8902-cff9d587dba5]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-569e25e5-4eb9-4ad3-b938-1f5b04219912 tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:41 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] Created reservations ['6251e5b1-9bdd-447c-a237-0df140563e96', 'f9cc5b22-3f01-47b9-ae34-9c099a9552a3', '3cfb45b8-e49b-4185-a72a-e3bc17553a9b', '96e651a0-fca5-4a3e-b864-9de4f078d64a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:42 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1 Jul 13 20:49:42 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:42 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:42 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] Acquiring lock "cinder-29e479aa-d62e-451a-8266-b901a5649694-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] Lock "cinder-29e479aa-d62e-451a-8266-b901a5649694-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] Acquiring lock "cinder-quobyte-29e479aa-d62e-451a-8266-b901a5649694" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] Lock "cinder-quobyte-29e479aa-d62e-451a-8266-b901a5649694" acquired by "delete_volume" :: waited 0.035s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:42 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac553184-84e5-4ed6-a1d8-276cd7edc403]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-29e479aa-d62e-451a-8266-b901a5649694 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:42 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.464s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:42 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:42 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] Deleted volume successfully. Jul 13 20:49:42 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-569e25e5-4eb9-4ad3-b938-1f5b04219912 tempest-CinderUnicodeTest-217711761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1" returned: 0 in 0.657s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-569e25e5-4eb9-4ad3-b938-1f5b04219912 tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:42 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-29e479aa-d62e-451a-8266-b901a5649694 Jul 13 20:49:42 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8023934e-2453-4015-87e8-bf992ebbe363 tempest-VolumeDependencyTests-2128252877 None] Lock "cinder-b57c3bf3-52df-4d5c-b63e-d191390b078f-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:42 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638 1G Jul 13 20:49:42 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:42 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-29e479aa-d62e-451a-8266-b901a5649694" returned: 0 in 0.476s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-29e479aa-d62e-451a-8266-b901a5649694 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:42 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-29e479aa-d62e-451a-8266-b901a5649694 Jul 13 20:49:42 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:42 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-569e25e5-4eb9-4ad3-b938-1f5b04219912 tempest-CinderUnicodeTest-217711761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638 1G" returned: 0 in 0.490s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-569e25e5-4eb9-4ad3-b938-1f5b04219912 tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:43 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638 Jul 13 20:49:43 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:43 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-29e479aa-d62e-451a-8266-b901a5649694" returned: 0 in 0.280s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] Lock "cinder-quobyte-29e479aa-d62e-451a-8266-b901a5649694" released by "delete_volume" :: held 0.823s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:43 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] Created reservations ['8ce0ea58-cc53-4c47-a513-4f49b844314c', 'f2cee93b-6a08-4177-8ed9-0cdd7d1f1ad0', 'bea1cf9e-a208-4123-8c0c-bcd0b591fe4c', 'ca78a93f-103d-4efe-b66b-d2425bc8821e'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:43 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:43 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:43 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-569e25e5-4eb9-4ad3-b938-1f5b04219912 tempest-CinderUnicodeTest-217711761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638" returned: 0 in 0.366s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:43 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-569e25e5-4eb9-4ad3-b938-1f5b04219912 tempest-CinderUnicodeTest-217711761 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638 is being set with open permissions: ugo+rw Jul 13 20:49:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-569e25e5-4eb9-4ad3-b938-1f5b04219912 tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:43 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638 Jul 13 20:49:43 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:43 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.321s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:43 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:43 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] Deleted volume successfully. Jul 13 20:49:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f0ae75da-9816-4fb6-80bb-42efc64264c3 tempest-VolumeDependencyTests-2128252877 None] Lock "cinder-29e479aa-d62e-451a-8266-b901a5649694-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:43 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-569e25e5-4eb9-4ad3-b938-1f5b04219912 tempest-CinderUnicodeTest-217711761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638" returned: 0 in 0.351s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-569e25e5-4eb9-4ad3-b938-1f5b04219912 tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:43 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.info Jul 13 20:49:43 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:44 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-569e25e5-4eb9-4ad3-b938-1f5b04219912 tempest-CinderUnicodeTest-217711761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.info" returned: 0 in 0.367s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:44 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-569e25e5-4eb9-4ad3-b938-1f5b04219912 tempest-CinderUnicodeTest-217711761 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.info is being set with open permissions: ugo+rw Jul 13 20:49:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-569e25e5-4eb9-4ad3-b938-1f5b04219912 tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:44 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.info Jul 13 20:49:44 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:44 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-569e25e5-4eb9-4ad3-b938-1f5b04219912 tempest-CinderUnicodeTest-217711761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.info" returned: 0 in 0.312s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-569e25e5-4eb9-4ad3-b938-1f5b04219912 tempest-CinderUnicodeTest-217711761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.691s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:44 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-569e25e5-4eb9-4ad3-b938-1f5b04219912 tempest-CinderUnicodeTest-217711761 None] Create snapshot completed successfully Jul 13 20:49:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] Acquiring lock "cinder-a19c0548-daaa-40d8-b3a5-8f618828d638-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] Lock "cinder-a19c0548-daaa-40d8-b3a5-8f618828d638-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] Acquiring lock "cinder-quobyte-5d7155ef-67b3-409c-92b2-b6b4d63279c1" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] Lock "cinder-quobyte-5d7155ef-67b3-409c-92b2-b6b4d63279c1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] Acquiring lock "cinder-quobyte-a19c0548-daaa-40d8-b3a5-8f618828d638" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] Lock "cinder-quobyte-a19c0548-daaa-40d8-b3a5-8f618828d638" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] Deleting offline snapshot a19c0548-daaa-40d8-b3a5-8f618828d638 of volume 5d7155ef-67b3-409c-92b2-b6b4d63279c1 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:49:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] snapshot_file for this snap is: volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:49:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea66ebdc-ab75-4559-b98e-b700e49b9ac6]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:45 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638 Jul 13 20:49:45 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:45 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638" returned: 0 in 0.470s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:49:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[429d5978-a8cc-454a-9439-8c2eaf474261]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:45 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1 Jul 13 20:49:45 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:46 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1" returned: 0 in 0.494s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:46 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638 Jul 13 20:49:46 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:46 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638" returned: 0 in 0.441s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:46 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638 Jul 13 20:49:46 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:46 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1.a19c0548-daaa-40d8-b3a5-8f618828d638" returned: 0 in 0.353s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] Lock "cinder-quobyte-a19c0548-daaa-40d8-b3a5-8f618828d638" released by "_delete_snapshot" :: held 1.905s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] Lock "cinder-quobyte-5d7155ef-67b3-409c-92b2-b6b4d63279c1" released by "delete_snapshot" :: held 1.927s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:47 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] Created reservations ['a937e289-f062-4666-9e62-e83a033b745a', '1180e4f5-d852-4693-89fd-5f63289e61e5', 'ec7396fa-0c64-4e89-9265-f9bdd0d3355f', '9e1a2292-4e1f-4181-953b-4d12fb68fb60'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] Delete snapshot completed successfully. Jul 13 20:49:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d7399de9-766f-4b2b-854a-df274e8e1296 tempest-CinderUnicodeTest-217711761 None] Lock "cinder-a19c0548-daaa-40d8-b3a5-8f618828d638-delete_snapshot" released by "delete_snapshot" :: held 2.094s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] Acquiring lock "cinder-5d7155ef-67b3-409c-92b2-b6b4d63279c1-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] Lock "cinder-5d7155ef-67b3-409c-92b2-b6b4d63279c1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] Acquiring lock "cinder-quobyte-5d7155ef-67b3-409c-92b2-b6b4d63279c1" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] Lock "cinder-quobyte-5d7155ef-67b3-409c-92b2-b6b4d63279c1" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:47 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[db69397d-bedb-461f-8067-b7db0cf0e073]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:47 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1 Jul 13 20:49:47 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:47 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1" returned: 0 in 0.431s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:47 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1 Jul 13 20:49:47 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:48 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-5d7155ef-67b3-409c-92b2-b6b4d63279c1" returned: 0 in 0.328s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] Lock "cinder-quobyte-5d7155ef-67b3-409c-92b2-b6b4d63279c1" released by "delete_volume" :: held 0.839s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] Created reservations ['36aeeb46-1c62-4abf-9281-e0e17dd71a1e', '84cb64df-a3cd-4abe-a7b9-fff10230c233', '4580ac9e-9a3b-4c7b-97dc-670a75457d42', '76c2fe4d-1e65-41ba-ac16-1400af48213d'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:48 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:48 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] Acquiring lock "cinder-f1691914-9f30-4cf3-a377-29a961b8c76f-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] Lock "cinder-f1691914-9f30-4cf3-a377-29a961b8c76f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] Acquiring lock "cinder-quobyte-f1691914-9f30-4cf3-a377-29a961b8c76f" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] Lock "cinder-quobyte-f1691914-9f30-4cf3-a377-29a961b8c76f" acquired by "delete_volume" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d975f0b-be14-4003-bb96-6b9e8b6ff387]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1691914-9f30-4cf3-a377-29a961b8c76f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:48 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.352s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:48 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] Deleted volume successfully. Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6cecbc96-9817-4d81-88bb-e09b7349f6fc tempest-CinderUnicodeTest-217711761 None] Lock "cinder-5d7155ef-67b3-409c-92b2-b6b4d63279c1-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:48 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1691914-9f30-4cf3-a377-29a961b8c76f Jul 13 20:49:48 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Flow 'volume_create_manager' (d2127ede-bb60-48d5-bdde-06523ca294de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099a3613-bb95-44ea-bc59-c92db72ff505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099a3613-bb95-44ea-bc59-c92db72ff505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-772321693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c7a993-dd7b-4779-bd9b-dfe7a2269463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ad6530b4fd45b1b814e1b58730f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:49Z,use_quota=True,user_id='85687734f02f4a1a873b2b2a1c31ea8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626f19a3-15fa-4e22-9720-4a9071283604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626f19a3-15fa-4e22-9720-4a9071283604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c480de-de24-4ffd-97ce-c54a17a911e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c480de-de24-4ffd-97ce-c54a17a911e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04c7a993-dd7b-4779-bd9b-dfe7a2269463', 'volume_name': 'volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ac6533-4ad4-434a-99f0-42a879a2fa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ac6533-4ad4-434a-99f0-42a879a2fa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8ae80b-f24a-4aa7-8f41-1da119bb930d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:49 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Volume 04c7a993-dd7b-4779-bd9b-dfe7a2269463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463', 'volume_size': 1} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-772321693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c7a993-dd7b-4779-bd9b-dfe7a2269463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ad6530b4fd45b1b814e1b58730f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:49Z,use_quota=True,user_id='85687734f02f4a1a873b2b2a1c31ea8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Creating volume 04c7a993-dd7b-4779-bd9b-dfe7a2269463 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:49 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:49 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463 1073741824 Jul 13 20:49:49 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:49 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1691914-9f30-4cf3-a377-29a961b8c76f" returned: 0 in 0.526s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1691914-9f30-4cf3-a377-29a961b8c76f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:49 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1691914-9f30-4cf3-a377-29a961b8c76f Jul 13 20:49:49 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:49 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-f1691914-9f30-4cf3-a377-29a961b8c76f" returned: 0 in 0.289s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] Lock "cinder-quobyte-f1691914-9f30-4cf3-a377-29a961b8c76f" released by "delete_volume" :: held 0.887s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] Created reservations ['3e122522-8f48-4dda-bb8a-b6ee46f2d0f9', '4961667f-8f92-4f78-9019-1a04916c53dc', '4c36f3ec-2c52-4f96-bf0d-5002c4d67e24', '08be5139-e55b-468b-aa56-7c30f6701f96'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:49 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:49 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:49 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463 1073741824" returned: 0 in 0.671s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:49 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463 Jul 13 20:49:49 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:49 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.277s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:49 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] Deleted volume successfully. Jul 13 20:49:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ddaa98da-d00b-4d47-92c5-327042d2191c tempest-CinderUnicodeTest-217711761 None] Lock "cinder-f1691914-9f30-4cf3-a377-29a961b8c76f-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:50 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463" returned: 0 in 0.316s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8ae80b-f24a-4aa7-8f41-1da119bb930d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4137c52-8f9d-4f0a-8f9b-582300a2fef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:50 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Volume volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463 (04c7a993-dd7b-4779-bd9b-dfe7a2269463): created successfully Jul 13 20:49:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4137c52-8f9d-4f0a-8f9b-582300a2fef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Flow 'volume_create_manager' (d2127ede-bb60-48d5-bdde-06523ca294de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:50 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-47df88e6-ea6e-4599-8173-891991f7e772 tempest-ProjectReaderTests-896704004 None] Created volume successfully. Jul 13 20:49:51 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Flow 'volume_create_manager' (5eb02034-957e-42b3-8ea1-47269c5dfd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023cce70-49de-4a77-903d-2b3ede4c8813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023cce70-49de-4a77-903d-2b3ede4c8813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33410a5-ff7e-44f0-8bc4-ac31248942ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faef1fd5e46b41aa9cb27116b0341479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:51Z,use_quota=True,user_id='f022d48695674eceb8768bdf7006137c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5bc115-35ca-48e3-9290-c7e6be841707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5bc115-35ca-48e3-9290-c7e6be841707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb6b018-d4bd-42d4-8dfd-8a1d9eabc59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:51 devstack cinder-volume[87269]: DEBUG cinder.image.glance [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Creating Keystone auth plugin from conf {{(pid=87269) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 13 20:49:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a15a83fe-d179-4adb-af89-9453fe6e54d1 tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a15a83fe-d179-4adb-af89-9453fe6e54d1 tempest-ProjectReaderTests-896704004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a15a83fe-d179-4adb-af89-9453fe6e54d1 tempest-ProjectReaderTests-896704004 None] Creating offline snapshot aa5c4cd6-178c-48dd-91bf-c84bb3c23320 of volume 04c7a993-dd7b-4779-bd9b-dfe7a2269463 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:49:51 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d884e2d3-73df-4e49-beaa-18052a8bc975]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a15a83fe-d179-4adb-af89-9453fe6e54d1 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:51 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463 Jul 13 20:49:51 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb6b018-d4bd-42d4-8dfd-8a1d9eabc59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e33410a5-ff7e-44f0-8bc4-ac31248942ba', 'volume_name': 'volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba', 'volume_size': 1, 'image_id': '64cd8fbf-c6a1-49af-a375-3caed660de6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64cd8fbf-c6a1-49af-a375-3caed660de6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '89bea027fa8064a8c49a32e5cc1a8ca5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'faef1fd5e46b41aa9cb27116b0341479', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '50a7b513262903a4796246d6c0d4070b1053f47027a1d5db51b6fd1db1921d5c9120ba3daa9910eb03da4bc35ac9eb8b859f24840512da7ed90f1c515844bddb', 'id': '64cd8fbf-c6a1-49af-a375-3caed660de6e', 'created_at': datetime.datetime(2026, 7, 13, 18, 49, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 49, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64cd8fbf-c6a1-49af-a375-3caed660de6e/file', 'properties': {}}, 'image_service': }' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3cdeaf-fce5-46a2-b961-447a79aa1094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3cdeaf-fce5-46a2-b961-447a79aa1094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eac4a2f-6087-40f5-a79f-7411ce3afde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:51 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Volume e33410a5-ff7e-44f0-8bc4-ac31248942ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba', 'volume_size': 1, 'image_id': '64cd8fbf-c6a1-49af-a375-3caed660de6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64cd8fbf-c6a1-49af-a375-3caed660de6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '89bea027fa8064a8c49a32e5cc1a8ca5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'faef1fd5e46b41aa9cb27116b0341479', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '50a7b513262903a4796246d6c0d4070b1053f47027a1d5db51b6fd1db1921d5c9120ba3daa9910eb03da4bc35ac9eb8b859f24840512da7ed90f1c515844bddb', 'id': '64cd8fbf-c6a1-49af-a375-3caed660de6e', 'created_at': datetime.datetime(2026, 7, 13, 18, 49, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 49, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64cd8fbf-c6a1-49af-a375-3caed660de6e/file', 'properties': {}}, 'image_service': } Jul 13 20:49:51 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Trying to clone e33410a5-ff7e-44f0-8bc4-ac31248942ba from image 64cd8fbf-c6a1-49af-a375-3caed660de6e at location (None, [{'url': 'file:///opt/stack/data/glance/images/64cd8fbf-c6a1-49af-a375-3caed660de6e', 'metadata': {}}]). {{(pid=87269) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 13 20:49:51 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 13 20:49:51 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Image download 0.00 MB at 0.00 MB/s Jul 13 20:49:52 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a15a83fe-d179-4adb-af89-9453fe6e54d1 tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463" returned: 0 in 0.652s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a15a83fe-d179-4adb-af89-9453fe6e54d1 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:52 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd96aab-b4f1-496b-93d6-dfbd9e188522]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:52 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320 1G Jul 13 20:49:52 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:52 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD Jul 13 20:49:52 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:52 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD" returned: 0 in 0.517s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:52 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD Jul 13 20:49:52 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:52 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a15a83fe-d179-4adb-af89-9453fe6e54d1 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320 1G" returned: 0 in 0.735s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a15a83fe-d179-4adb-af89-9453fe6e54d1 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:52 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320 Jul 13 20:49:52 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:52 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD" returned: 1 in 0.376s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:49:53 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Temporary image 64cd8fbf-c6a1-49af-a375-3caed660de6e is fetched for user f022d48695674eceb8768bdf7006137c. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 13 20:49:53 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe999ea0-4a25-48e1-8d15-4feef8338486]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:53 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a15a83fe-d179-4adb-af89-9453fe6e54d1 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320" returned: 0 in 0.403s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:53 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-a15a83fe-d179-4adb-af89-9453fe6e54d1 tempest-ProjectReaderTests-896704004 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320 is being set with open permissions: ugo+rw Jul 13 20:49:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a15a83fe-d179-4adb-af89-9453fe6e54d1 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:53 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD Jul 13 20:49:53 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:53 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320 Jul 13 20:49:53 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:53 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:53 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a15a83fe-d179-4adb-af89-9453fe6e54d1 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320" returned: 0 in 0.373s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a15a83fe-d179-4adb-af89-9453fe6e54d1 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:53 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.info Jul 13 20:49:53 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:53 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD Jul 13 20:49:53 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:53 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a15a83fe-d179-4adb-af89-9453fe6e54d1 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.info" returned: 0 in 0.265s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:53 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-a15a83fe-d179-4adb-af89-9453fe6e54d1 tempest-ProjectReaderTests-896704004 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.info is being set with open permissions: ugo+rw Jul 13 20:49:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a15a83fe-d179-4adb-af89-9453fe6e54d1 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:53 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD" returned: 1 in 0.376s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:49:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:53 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.info Jul 13 20:49:53 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:54 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a15a83fe-d179-4adb-af89-9453fe6e54d1 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.info" returned: 0 in 0.255s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a15a83fe-d179-4adb-af89-9453fe6e54d1 tempest-ProjectReaderTests-896704004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.793s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.259s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33410a5-ff7e-44f0-8bc4-ac31248942ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faef1fd5e46b41aa9cb27116b0341479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:51Z,use_quota=True,user_id='f022d48695674eceb8768bdf7006137c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Creating volume e33410a5-ff7e-44f0-8bc4-ac31248942ba {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:54 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:54 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba 1073741824 Jul 13 20:49:54 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a15a83fe-d179-4adb-af89-9453fe6e54d1 tempest-ProjectReaderTests-896704004 None] Create snapshot completed successfully Jul 13 20:49:54 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba 1073741824" returned: 0 in 0.545s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:54 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba Jul 13 20:49:54 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-aa5c4cd6-178c-48dd-91bf-c84bb3c23320-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] Lock "cinder-aa5c4cd6-178c-48dd-91bf-c84bb3c23320-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-quobyte-04c7a993-dd7b-4779-bd9b-dfe7a2269463" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-04c7a993-dd7b-4779-bd9b-dfe7a2269463" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-quobyte-aa5c4cd6-178c-48dd-91bf-c84bb3c23320" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-aa5c4cd6-178c-48dd-91bf-c84bb3c23320" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] Deleting offline snapshot aa5c4cd6-178c-48dd-91bf-c84bb3c23320 of volume 04c7a993-dd7b-4779-bd9b-dfe7a2269463 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] snapshot_file for this snap is: volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b84542-0d11-471e-ad99-8f1f4fda8dc2]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:55 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba" returned: 0 in 0.340s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:49:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:55 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320 Jul 13 20:49:55 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:55 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Attempting download of 64cd8fbf-c6a1-49af-a375-3caed660de6e ((None, [{'url': 'file:///opt/stack/data/glance/images/64cd8fbf-c6a1-49af-a375-3caed660de6e', 'metadata': {}}])) to volume e33410a5-ff7e-44f0-8bc4-ac31248942ba. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 13 20:49:55 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6d4557-da82-4e6b-a57b-ac30d1cebc80]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64cd8fbf-c6a1-49af-a375-3caed660de6e_5374ynzl {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:55 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64cd8fbf-c6a1-49af-a375-3caed660de6e_5374ynzl Jul 13 20:49:55 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:55 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320" returned: 0 in 0.555s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:49:55 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[058b4f96-9d98-44df-baf4-94a10fd1c0cd]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:55 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64cd8fbf-c6a1-49af-a375-3caed660de6e_5374ynzl" returned: 0 in 0.429s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64cd8fbf-c6a1-49af-a375-3caed660de6e_5374ynzl {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:55 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463 Jul 13 20:49:55 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:55 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64cd8fbf-c6a1-49af-a375-3caed660de6e_5374ynzl Jul 13 20:49:55 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:56 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463" returned: 0 in 0.480s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:56 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64cd8fbf-c6a1-49af-a375-3caed660de6e_5374ynzl" returned: 1 in 0.401s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64cd8fbf-c6a1-49af-a375-3caed660de6e_5374ynzl' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:49:56 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cc6222-26bd-490d-b9c7-635c95977beb]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:56 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320 Jul 13 20:49:56 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:56 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD Jul 13 20:49:56 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:56 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:56 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320" returned: 0 in 0.385s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:56 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320 Jul 13 20:49:56 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:56 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD Jul 13 20:49:56 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:56 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463.aa5c4cd6-178c-48dd-91bf-c84bb3c23320" returned: 0 in 0.288s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-aa5c4cd6-178c-48dd-91bf-c84bb3c23320" released by "_delete_snapshot" :: held 1.830s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-04c7a993-dd7b-4779-bd9b-dfe7a2269463" released by "delete_snapshot" :: held 1.855s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:56 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] Created reservations ['8a26f445-5e28-4ff4-98d0-f6d71a3417cb', '375138ca-524a-4ec8-9804-745c2004dc37', 'f081936a-6dbc-4aee-bcdc-036df24e741e', '1f9a617e-445b-4dd4-aaa1-e41191b548d7'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:56 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD" returned: 1 in 0.396s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:49:56 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] 64cd8fbf-c6a1-49af-a375-3caed660de6e was raw, converting to raw {{(pid=87269) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 13 20:49:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:56 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba Jul 13 20:49:56 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:56 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] Delete snapshot completed successfully. Jul 13 20:49:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-add96de4-e434-4652-96cc-567a64feb947 tempest-ProjectReaderTests-896704004 None] Lock "cinder-aa5c4cd6-178c-48dd-91bf-c84bb3c23320-delete_snapshot" released by "delete_snapshot" :: held 2.091s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-04c7a993-dd7b-4779-bd9b-dfe7a2269463-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] Lock "cinder-04c7a993-dd7b-4779-bd9b-dfe7a2269463-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:57 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=282,cinder:SELECT=202,cinder:INSERT=72,cinder:DELETE=26 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:49:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-quobyte-04c7a993-dd7b-4779-bd9b-dfe7a2269463" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-04c7a993-dd7b-4779-bd9b-dfe7a2269463" acquired by "delete_volume" :: waited 0.036s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:57 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48a0aed-6617-475a-a318-12243636cd4d]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:57 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba" returned: 0 in 0.525s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:57 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_64cd8fbf-c6a1-49af-a375-3caed660de6e_rg8aehx3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:49:57 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Converted 0.00 MB image at 0.00 MB/s Jul 13 20:49:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:57 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463 Jul 13 20:49:57 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:57 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba 1G Jul 13 20:49:57 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:57 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463" returned: 0 in 0.485s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:57 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba 1G" returned: 0 in 0.401s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:57 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463 Jul 13 20:49:57 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:57 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d66f1dc-a1a9-492f-8261-63d7e7b0dc43]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:49:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:57 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba Jul 13 20:49:57 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:58 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-04c7a993-dd7b-4779-bd9b-dfe7a2269463" returned: 0 in 0.318s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-04c7a993-dd7b-4779-bd9b-dfe7a2269463" released by "delete_volume" :: held 0.900s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=201,cinder:UPDATE=272,cinder:INSERT=70,cinder:DELETE=23 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] Created reservations ['bfcd78b0-4ec0-4bfe-a39d-69bf474f3b80', 'bcce8204-a51a-48d5-bd3d-6eb2757c9334', '745e5890-6350-450e-9bf9-8e1661ab9d3b', '684f7cab-4846-4ae9-acb0-11d000288961'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:49:58 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba" returned: 0 in 0.413s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:58 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:49:58 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:58 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba Jul 13 20:49:58 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.367s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:49:58 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:58 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] Deleted volume successfully. Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-069dbe3b-8a71-4b4f-96c1-cec9cac9259a tempest-ProjectReaderTests-896704004 None] Lock "cinder-04c7a993-dd7b-4779-bd9b-dfe7a2269463-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:49:58 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba" returned: 1 in 0.677s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Downloaded image 64cd8fbf-c6a1-49af-a375-3caed660de6e ((None, [{'url': 'file:///opt/stack/data/glance/images/64cd8fbf-c6a1-49af-a375-3caed660de6e', 'metadata': {}}])) to volume e33410a5-ff7e-44f0-8bc4-ac31248942ba successfully. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Temporary image 64cd8fbf-c6a1-49af-a375-3caed660de6e for user f022d48695674eceb8768bdf7006137c is deleted. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Marking volume e33410a5-ff7e-44f0-8bc4-ac31248942ba as bootable. {{(pid=87269) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Copying metadata from image 64cd8fbf-c6a1-49af-a375-3caed660de6e to e33410a5-ff7e-44f0-8bc4-ac31248942ba. {{(pid=87269) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Creating volume glance metadata for volume e33410a5-ff7e-44f0-8bc4-ac31248942ba backed by image 64cd8fbf-c6a1-49af-a375-3caed660de6e with: {'image_id': '64cd8fbf-c6a1-49af-a375-3caed660de6e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '89bea027fa8064a8c49a32e5cc1a8ca5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87269) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:49:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Flow 'volume_create_manager' (9ac349ed-ca27-474e-9999-c63d6766debf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59499e88-0fb4-4801-bef8-d8c5b2f3ca85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59499e88-0fb4-4801-bef8-d8c5b2f3ca85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-695825903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4ff406-42d3-4e66-9838-b6d211a8cc9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ad6530b4fd45b1b814e1b58730f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:59Z,use_quota=True,user_id='85687734f02f4a1a873b2b2a1c31ea8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a91b19d-8ed3-4900-8537-a05b0dd04908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a91b19d-8ed3-4900-8537-a05b0dd04908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66c7c06-0ee0-4be2-bfd0-4872fd091663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66c7c06-0ee0-4be2-bfd0-4872fd091663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd4ff406-42d3-4e66-9838-b6d211a8cc9e', 'volume_name': 'volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d0ad58-a793-47d7-84a1-56830cc748c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d0ad58-a793-47d7-84a1-56830cc748c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b0d012-f06e-44a0-a9aa-80e59f8dc00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:59 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Volume fd4ff406-42d3-4e66-9838-b6d211a8cc9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e', 'volume_size': 1} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-695825903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4ff406-42d3-4e66-9838-b6d211a8cc9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ad6530b4fd45b1b814e1b58730f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:49:59Z,use_quota=True,user_id='85687734f02f4a1a873b2b2a1c31ea8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Creating volume fd4ff406-42d3-4e66-9838-b6d211a8cc9e {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:49:59 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:59 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e 1073741824 Jul 13 20:49:59 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eac4a2f-6087-40f5-a79f-7411ce3afde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba', 'volume_size': 1, 'image_id': '64cd8fbf-c6a1-49af-a375-3caed660de6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64cd8fbf-c6a1-49af-a375-3caed660de6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '89bea027fa8064a8c49a32e5cc1a8ca5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'faef1fd5e46b41aa9cb27116b0341479', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '50a7b513262903a4796246d6c0d4070b1053f47027a1d5db51b6fd1db1921d5c9120ba3daa9910eb03da4bc35ac9eb8b859f24840512da7ed90f1c515844bddb', 'id': '64cd8fbf-c6a1-49af-a375-3caed660de6e', 'created_at': datetime.datetime(2026, 7, 13, 18, 49, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 18, 49, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64cd8fbf-c6a1-49af-a375-3caed660de6e/file', 'properties': {}}, 'image_service': }' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183eeb5c-280a-434a-a4c8-58f0d4a6452c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:49:59 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Volume volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba (e33410a5-ff7e-44f0-8bc4-ac31248942ba): created successfully Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183eeb5c-280a-434a-a4c8-58f0d4a6452c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Flow 'volume_create_manager' (5eb02034-957e-42b3-8ea1-47269c5dfd04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:49:59 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-11245eb0-a68c-43c4-b051-bfff67097811 tempest-VolumeImageDependencyTests-361311470 None] Created volume successfully. Jul 13 20:49:59 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e 1073741824" returned: 0 in 0.577s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:49:59 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e Jul 13 20:49:59 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] Acquiring lock "cinder-e33410a5-ff7e-44f0-8bc4-ac31248942ba-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] Lock "cinder-e33410a5-ff7e-44f0-8bc4-ac31248942ba-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:49:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] Acquiring lock "cinder-quobyte-e33410a5-ff7e-44f0-8bc4-ac31248942ba" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:00 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] Lock "cinder-quobyte-e33410a5-ff7e-44f0-8bc4-ac31248942ba" acquired by "delete_volume" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e" returned: 0 in 0.346s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:50:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b0d012-f06e-44a0-a9aa-80e59f8dc00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4769a58-5c68-4a4a-b1e4-73fcbf04f661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:00 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Volume volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e (fd4ff406-42d3-4e66-9838-b6d211a8cc9e): created successfully Jul 13 20:50:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4769a58-5c68-4a4a-b1e4-73fcbf04f661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Flow 'volume_create_manager' (9ac349ed-ca27-474e-9999-c63d6766debf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:00 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[addf6aac-5870-4029-b359-1b5322993c4c]: (4, 'raw') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:00 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-deb210f8-f632-4b4e-a914-10e1816fec47 tempest-ProjectReaderTests-896704004 None] Created volume successfully. Jul 13 20:50:00 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba Jul 13 20:50:00 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:00 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba" returned: 0 in 0.463s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:00 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba Jul 13 20:50:00 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:00 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba" returned: 1 in 0.418s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 20:50:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:01 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba Jul 13 20:50:01 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:01 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e33410a5-ff7e-44f0-8bc4-ac31248942ba" returned: 0 in 0.402s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] Lock "cinder-quobyte-e33410a5-ff7e-44f0-8bc4-ac31248942ba" released by "delete_volume" :: held 1.386s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab5bc2bb-81f6-4a19-9e47-ec24ba7d3395 tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab5bc2bb-81f6-4a19-9e47-ec24ba7d3395 tempest-ProjectReaderTests-896704004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ab5bc2bb-81f6-4a19-9e47-ec24ba7d3395 tempest-ProjectReaderTests-896704004 None] Creating offline snapshot 26d34af1-fc06-494d-9af0-5076dbbfca73 of volume fd4ff406-42d3-4e66-9838-b6d211a8cc9e {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:50:01 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0b89c6-311f-483e-84e4-3909ff905399]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab5bc2bb-81f6-4a19-9e47-ec24ba7d3395 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:01 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] Created reservations ['8b302bcf-c73d-4962-b99a-52bd063ecd4b', '3116ff0e-5d51-4e8d-aa1f-25ff66415f1d', 'b7d4eb35-8e9f-4135-b9e6-875d3e6cc85d', '0557c7ca-2f4c-4ed9-ae5e-6b6d3f5f0a4a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:01 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e Jul 13 20:50:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:01 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:01 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:50:01 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:01 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab5bc2bb-81f6-4a19-9e47-ec24ba7d3395 tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e" returned: 0 in 0.439s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab5bc2bb-81f6-4a19-9e47-ec24ba7d3395 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:01 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.320s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:50:01 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] Deleted volume successfully. Jul 13 20:50:01 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73 1G Jul 13 20:50:01 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c899364d-740d-425d-bd01-ff2b3691e19e tempest-VolumeImageDependencyTests-361311470 None] Lock "cinder-e33410a5-ff7e-44f0-8bc4-ac31248942ba-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:02 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab5bc2bb-81f6-4a19-9e47-ec24ba7d3395 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73 1G" returned: 0 in 0.621s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab5bc2bb-81f6-4a19-9e47-ec24ba7d3395 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:02 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73 Jul 13 20:50:02 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:02 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab5bc2bb-81f6-4a19-9e47-ec24ba7d3395 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73" returned: 0 in 0.439s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:02 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-ab5bc2bb-81f6-4a19-9e47-ec24ba7d3395 tempest-ProjectReaderTests-896704004 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73 is being set with open permissions: ugo+rw Jul 13 20:50:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab5bc2bb-81f6-4a19-9e47-ec24ba7d3395 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:03 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73 Jul 13 20:50:03 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:03 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab5bc2bb-81f6-4a19-9e47-ec24ba7d3395 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73" returned: 0 in 0.379s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab5bc2bb-81f6-4a19-9e47-ec24ba7d3395 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:03 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.info Jul 13 20:50:03 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:03 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab5bc2bb-81f6-4a19-9e47-ec24ba7d3395 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.info" returned: 0 in 0.293s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:03 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-ab5bc2bb-81f6-4a19-9e47-ec24ba7d3395 tempest-ProjectReaderTests-896704004 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.info is being set with open permissions: ugo+rw Jul 13 20:50:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab5bc2bb-81f6-4a19-9e47-ec24ba7d3395 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:03 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.info Jul 13 20:50:03 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:04 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab5bc2bb-81f6-4a19-9e47-ec24ba7d3395 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.info" returned: 0 in 0.345s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab5bc2bb-81f6-4a19-9e47-ec24ba7d3395 tempest-ProjectReaderTests-896704004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.639s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ab5bc2bb-81f6-4a19-9e47-ec24ba7d3395 tempest-ProjectReaderTests-896704004 None] Create snapshot completed successfully Jul 13 20:50:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-26d34af1-fc06-494d-9af0-5076dbbfca73-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] Lock "cinder-26d34af1-fc06-494d-9af0-5076dbbfca73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-quobyte-fd4ff406-42d3-4e66-9838-b6d211a8cc9e" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-fd4ff406-42d3-4e66-9838-b6d211a8cc9e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-quobyte-26d34af1-fc06-494d-9af0-5076dbbfca73" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-26d34af1-fc06-494d-9af0-5076dbbfca73" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] Deleting offline snapshot 26d34af1-fc06-494d-9af0-5076dbbfca73 of volume fd4ff406-42d3-4e66-9838-b6d211a8cc9e {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:50:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] snapshot_file for this snap is: volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:50:04 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3167b1-99ec-4413-9956-704bdc981139]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:04 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73 Jul 13 20:50:04 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:05 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73" returned: 0 in 0.460s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:50:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03131b2-b4e7-45b8-85da-a17e1368ce38]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:05 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e Jul 13 20:50:05 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:05 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e" returned: 0 in 0.582s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:05 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73 Jul 13 20:50:05 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:06 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73" returned: 0 in 0.555s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:06 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73 Jul 13 20:50:06 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:06 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e.26d34af1-fc06-494d-9af0-5076dbbfca73" returned: 0 in 0.404s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-26d34af1-fc06-494d-9af0-5076dbbfca73" released by "_delete_snapshot" :: held 2.195s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-fd4ff406-42d3-4e66-9838-b6d211a8cc9e" released by "delete_snapshot" :: held 2.222s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:07 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] Created reservations ['9cc43659-531e-4f03-adeb-05b134b3b08f', '00500473-5d02-4756-b767-41180ed30457', 'b83d5dac-050e-4cff-86a8-179abc85c1ee', '4b57019b-81c3-4710-8420-69d421bacc93'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] Delete snapshot completed successfully. Jul 13 20:50:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f781da6c-3ee4-4f90-a425-2db45e01fd6f tempest-ProjectReaderTests-896704004 None] Lock "cinder-26d34af1-fc06-494d-9af0-5076dbbfca73-delete_snapshot" released by "delete_snapshot" :: held 2.518s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-670184f2-07ad-4725-81d1-2c134ff61c83 tempest-ProjectAdminTests-1513051832 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87269) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 13 20:50:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-fd4ff406-42d3-4e66-9838-b6d211a8cc9e-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] Lock "cinder-fd4ff406-42d3-4e66-9838-b6d211a8cc9e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-quobyte-fd4ff406-42d3-4e66-9838-b6d211a8cc9e" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-fd4ff406-42d3-4e66-9838-b6d211a8cc9e" acquired by "delete_volume" :: waited 0.040s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:08 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8ed749-47d1-4262-a850-b545b1a962cb]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:08 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e Jul 13 20:50:08 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:08 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e" returned: 0 in 0.554s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:08 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e Jul 13 20:50:08 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:09 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-fd4ff406-42d3-4e66-9838-b6d211a8cc9e" returned: 0 in 0.338s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-fd4ff406-42d3-4e66-9838-b6d211a8cc9e" released by "delete_volume" :: held 0.993s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:09 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] Created reservations ['a3384f1f-34e7-41c8-8f93-12a9a2ce882d', '7addbb5e-2213-445e-a370-edd19aba6fb3', 'f429e85a-d493-4e0c-aab5-aa632a37be1e', '481cf528-5b3b-4d60-951b-06a07fb31823'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:09 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:50:09 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:09 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.333s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:09 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:50:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] Deleted volume successfully. Jul 13 20:50:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a85b313d-3946-4857-a23d-86eaba0647ba tempest-ProjectReaderTests-896704004 None] Lock "cinder-fd4ff406-42d3-4e66-9838-b6d211a8cc9e-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Flow 'volume_create_manager' (c19ea63e-dc15-403b-8b8a-5ae5901ad5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (732540a2-f629-4ef6-a6f5-6d6e78174819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (732540a2-f629-4ef6-a6f5-6d6e78174819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1766934486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c3f52c-8941-4e64-8d83-2d01657f3ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ad6530b4fd45b1b814e1b58730f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:11Z,use_quota=True,user_id='85687734f02f4a1a873b2b2a1c31ea8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9acd5ef-2597-47b6-aacc-5c26b56330df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9acd5ef-2597-47b6-aacc-5c26b56330df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d3e230-332c-4477-bfc2-6951cfd45257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d3e230-332c-4477-bfc2-6951cfd45257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79c3f52c-8941-4e64-8d83-2d01657f3ff9', 'volume_name': 'volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e1a48b-e989-43e0-bb62-95fe06d69499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e1a48b-e989-43e0-bb62-95fe06d69499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b05af1-61d0-4af9-a8ea-95c36efada31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:11 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Volume 79c3f52c-8941-4e64-8d83-2d01657f3ff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9', 'volume_size': 1} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1766934486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c3f52c-8941-4e64-8d83-2d01657f3ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ad6530b4fd45b1b814e1b58730f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:11Z,use_quota=True,user_id='85687734f02f4a1a873b2b2a1c31ea8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Creating volume 79c3f52c-8941-4e64-8d83-2d01657f3ff9 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:50:11 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:11 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9 1073741824 Jul 13 20:50:11 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:11 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9 1073741824" returned: 0 in 0.571s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:11 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9 Jul 13 20:50:11 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:12 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9" returned: 0 in 0.315s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:50:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b05af1-61d0-4af9-a8ea-95c36efada31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc511083-87f6-450e-a0b5-21cb600b3e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:12 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Volume volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9 (79c3f52c-8941-4e64-8d83-2d01657f3ff9): created successfully Jul 13 20:50:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc511083-87f6-450e-a0b5-21cb600b3e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Flow 'volume_create_manager' (c19ea63e-dc15-403b-8b8a-5ae5901ad5c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-286772c1-5496-4801-9dcc-0c82c8bb691c tempest-ProjectReaderTests-896704004 None] Created volume successfully. Jul 13 20:50:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b64a36fa-d1b7-40f4-8d90-2e240a972be7 tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b64a36fa-d1b7-40f4-8d90-2e240a972be7 tempest-ProjectReaderTests-896704004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b64a36fa-d1b7-40f4-8d90-2e240a972be7 tempest-ProjectReaderTests-896704004 None] Creating offline snapshot 93066366-3381-4ef3-a57e-0bbb9563dc78 of volume 79c3f52c-8941-4e64-8d83-2d01657f3ff9 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:50:13 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e47e66a-8fe0-4db3-8195-102542daf5b4]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b64a36fa-d1b7-40f4-8d90-2e240a972be7 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:13 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9 Jul 13 20:50:13 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:13 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b64a36fa-d1b7-40f4-8d90-2e240a972be7 tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9" returned: 0 in 0.505s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b64a36fa-d1b7-40f4-8d90-2e240a972be7 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:14 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78 1G Jul 13 20:50:14 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:14 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:50:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Flow 'volume_create_manager' (208a0689-d7d8-4493-83ff-d55e9d5f7c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e88711-d09a-4673-b37a-413cf3d096a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e88711-d09a-4673-b37a-413cf3d096a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2021494224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dbc3742-5a3a-4cd5-acec-bc41530a8168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c38df1850474d9a82d8fc73b3b0553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:14Z,use_quota=True,user_id='ffe1c94cc7714b9b8648f410124784e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7877f31a-c50c-4a7b-beb1-148910f35304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7877f31a-c50c-4a7b-beb1-148910f35304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60dc0c6-34a4-49f2-84a3-3b9c4d5878c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60dc0c6-34a4-49f2-84a3-3b9c4d5878c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dbc3742-5a3a-4cd5-acec-bc41530a8168', 'volume_name': 'volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d356a78-d89e-4bfd-aa01-3f92c4701453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d356a78-d89e-4bfd-aa01-3f92c4701453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf0f2a5-3fe2-4c1b-833e-957802e29543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:14 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Volume 8dbc3742-5a3a-4cd5-acec-bc41530a8168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168', 'volume_size': 1} Jul 13 20:50:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:14 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b64a36fa-d1b7-40f4-8d90-2e240a972be7 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78 1G" returned: 0 in 0.496s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b64a36fa-d1b7-40f4-8d90-2e240a972be7 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:14 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78 Jul 13 20:50:14 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:14 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b64a36fa-d1b7-40f4-8d90-2e240a972be7 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78" returned: 0 in 0.338s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:14 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-b64a36fa-d1b7-40f4-8d90-2e240a972be7 tempest-ProjectReaderTests-896704004 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78 is being set with open permissions: ugo+rw Jul 13 20:50:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b64a36fa-d1b7-40f4-8d90-2e240a972be7 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:14 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78 Jul 13 20:50:14 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:15 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b64a36fa-d1b7-40f4-8d90-2e240a972be7 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78" returned: 0 in 0.251s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b64a36fa-d1b7-40f4-8d90-2e240a972be7 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:15 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.info Jul 13 20:50:15 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:15 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b64a36fa-d1b7-40f4-8d90-2e240a972be7 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.info" returned: 0 in 0.322s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:15 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-b64a36fa-d1b7-40f4-8d90-2e240a972be7 tempest-ProjectReaderTests-896704004 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.info is being set with open permissions: ugo+rw Jul 13 20:50:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b64a36fa-d1b7-40f4-8d90-2e240a972be7 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:15 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.info Jul 13 20:50:15 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:15 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b64a36fa-d1b7-40f4-8d90-2e240a972be7 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.info" returned: 0 in 0.260s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b64a36fa-d1b7-40f4-8d90-2e240a972be7 tempest-ProjectReaderTests-896704004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.305s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.286s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2021494224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dbc3742-5a3a-4cd5-acec-bc41530a8168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c38df1850474d9a82d8fc73b3b0553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:14Z,use_quota=True,user_id='ffe1c94cc7714b9b8648f410124784e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:50:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Creating volume 8dbc3742-5a3a-4cd5-acec-bc41530a8168 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:50:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:50:15 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:50:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b64a36fa-d1b7-40f4-8d90-2e240a972be7 tempest-ProjectReaderTests-896704004 None] Create snapshot completed successfully Jul 13 20:50:15 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168 1073741824 Jul 13 20:50:15 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:16 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168 1073741824" returned: 0 in 0.500s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:16 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168 Jul 13 20:50:16 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:16 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168" returned: 0 in 0.363s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-93066366-3381-4ef3-a57e-0bbb9563dc78-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf0f2a5-3fe2-4c1b-833e-957802e29543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc27fb94-ff42-4335-9a44-2c34e15fc718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] Lock "cinder-93066366-3381-4ef3-a57e-0bbb9563dc78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-quobyte-79c3f52c-8941-4e64-8d83-2d01657f3ff9" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:16 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Volume volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168 (8dbc3742-5a3a-4cd5-acec-bc41530a8168): created successfully Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc27fb94-ff42-4335-9a44-2c34e15fc718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Flow 'volume_create_manager' (208a0689-d7d8-4493-83ff-d55e9d5f7c3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Flow 'volume_create_manager' (56f04c8e-67cd-466f-9d8b-095492e8405f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e00fa7-e57f-413d-b737-516b94abcf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-79c3f52c-8941-4e64-8d83-2d01657f3ff9" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-quobyte-93066366-3381-4ef3-a57e-0bbb9563dc78" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e9c8985a-ea3a-45c5-ac8c-2436e45bc0e3 tempest-ProjectMemberTests-1245199771 None] Created volume successfully. Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e00fa7-e57f-413d-b737-516b94abcf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1862237556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1c07f3-1bfe-447f-81bb-a0ebb1c47680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b25f270ebf466ba7daf7f1233af4a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:17Z,use_quota=True,user_id='d453da7044e14137b28d642f5b01803d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27817d55-5e12-4ed7-a013-abbe7def5612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27817d55-5e12-4ed7-a013-abbe7def5612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bd19af-b423-45b1-a358-0a9fcd4bb23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bd19af-b423-45b1-a358-0a9fcd4bb23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc1c07f3-1bfe-447f-81bb-a0ebb1c47680', 'volume_name': 'volume-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027c5623-e853-4fef-80bc-153891132f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027c5623-e853-4fef-80bc-153891132f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d26755-37b4-4d4b-89d0-09b702933bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:16 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Volume dc1c07f3-1bfe-447f-81bb-a0ebb1c47680: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680', 'volume_size': 1} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1862237556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1c07f3-1bfe-447f-81bb-a0ebb1c47680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b25f270ebf466ba7daf7f1233af4a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:17Z,use_quota=True,user_id='d453da7044e14137b28d642f5b01803d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Creating volume dc1c07f3-1bfe-447f-81bb-a0ebb1c47680 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:50:16 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-93066366-3381-4ef3-a57e-0bbb9563dc78" acquired by "_delete_snapshot" :: waited 0.099s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:16 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680 1073741824 Jul 13 20:50:16 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] Deleting offline snapshot 93066366-3381-4ef3-a57e-0bbb9563dc78 of volume 79c3f52c-8941-4e64-8d83-2d01657f3ff9 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] snapshot_file for this snap is: volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb65ba0-09d1-4f70-9512-ea791497036d]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:17 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78 Jul 13 20:50:17 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:17 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78" returned: 0 in 0.393s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:50:17 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680 1073741824" returned: 0 in 0.500s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28ffac4-3247-4222-b84c-9a25f8300dbf]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:17 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680 Jul 13 20:50:17 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:17 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9 Jul 13 20:50:17 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:17 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680" returned: 0 in 0.331s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d26755-37b4-4d4b-89d0-09b702933bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256e434a-1bfc-491f-94c0-3a9190664322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:17 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Volume volume-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680 (dc1c07f3-1bfe-447f-81bb-a0ebb1c47680): created successfully Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256e434a-1bfc-491f-94c0-3a9190664322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Flow 'volume_create_manager' (56f04c8e-67cd-466f-9d8b-095492e8405f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-082a1877-2525-4842-8294-8d759b91829a tempest-ProjectReaderTests-1209755707 None] Created volume successfully. Jul 13 20:50:17 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9" returned: 0 in 0.511s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:17 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78 Jul 13 20:50:17 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-86816736-0825-4264-b28e-545c63bf126e tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-86816736-0825-4264-b28e-545c63bf126e tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-86816736-0825-4264-b28e-545c63bf126e tempest-ProjectMemberTests-1245199771 None] Creating offline snapshot 4a2532e3-ae99-4c2b-bc70-2e62ea809114 of volume 8dbc3742-5a3a-4cd5-acec-bc41530a8168 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db5493c-0ee1-49b0-8bce-c3840e1174a9]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86816736-0825-4264-b28e-545c63bf126e tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:18 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168 Jul 13 20:50:18 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:18 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78" returned: 0 in 0.541s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:18 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78 Jul 13 20:50:18 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:18 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86816736-0825-4264-b28e-545c63bf126e tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168" returned: 0 in 0.583s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86816736-0825-4264-b28e-545c63bf126e tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:18 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114 1G Jul 13 20:50:18 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:18 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9.93066366-3381-4ef3-a57e-0bbb9563dc78" returned: 0 in 0.331s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-93066366-3381-4ef3-a57e-0bbb9563dc78" released by "_delete_snapshot" :: held 1.929s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-79c3f52c-8941-4e64-8d83-2d01657f3ff9" released by "delete_snapshot" :: held 2.047s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:50:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:18 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:50:18 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:18 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] Created reservations ['6f15f4ac-2776-4a98-bfb1-b513a4fe8500', 'ab0b3a03-2f49-4412-b0e3-dfd962b6c268', '85cda5e9-eed1-424d-af8f-f7dc5106b3e9', '4efb3c1e-e3a6-4bd9-8d98-120a1b6d32a9'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] Acquiring lock "cinder-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] Lock "cinder-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] Delete snapshot completed successfully. Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-54f6503f-ac74-4dc9-80df-0e9b736db36d tempest-ProjectReaderTests-896704004 None] Lock "cinder-93066366-3381-4ef3-a57e-0bbb9563dc78-delete_snapshot" released by "delete_snapshot" :: held 2.454s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] Acquiring lock "cinder-quobyte-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] Lock "cinder-quobyte-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:19 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86816736-0825-4264-b28e-545c63bf126e tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114 1G" returned: 0 in 0.625s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86816736-0825-4264-b28e-545c63bf126e tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[92815b80-5821-46e5-9ca4-31952dbc168e]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:19 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114 Jul 13 20:50:19 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:19 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.422s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:50:19 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680 Jul 13 20:50:19 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:50:19 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86816736-0825-4264-b28e-545c63bf126e tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114" returned: 0 in 0.360s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:19 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-86816736-0825-4264-b28e-545c63bf126e tempest-ProjectMemberTests-1245199771 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114 is being set with open permissions: ugo+rw Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86816736-0825-4264-b28e-545c63bf126e tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:19 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114 Jul 13 20:50:19 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:19 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680" returned: 0 in 0.421s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:19 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680 Jul 13 20:50:19 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:19 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86816736-0825-4264-b28e-545c63bf126e tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114" returned: 0 in 0.253s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86816736-0825-4264-b28e-545c63bf126e tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:19 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.info Jul 13 20:50:19 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:19 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680" returned: 0 in 0.278s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] Lock "cinder-quobyte-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680" released by "delete_volume" :: held 0.761s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-79c3f52c-8941-4e64-8d83-2d01657f3ff9-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] Lock "cinder-79c3f52c-8941-4e64-8d83-2d01657f3ff9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-quobyte-79c3f52c-8941-4e64-8d83-2d01657f3ff9" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] Created reservations ['adc45fea-1040-46a6-8dc5-cc4842eeac43', 'a721981a-caab-4acf-960f-3eef846115dc', '6244a2b5-fad0-4ba6-a810-2cd97d4d9222', 'bc00eac5-221f-4032-ab62-201317a8f579'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-79c3f52c-8941-4e64-8d83-2d01657f3ff9" acquired by "delete_volume" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[703d242d-2164-4c06-b616-10f76e1f3ae8]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:20 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86816736-0825-4264-b28e-545c63bf126e tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.info" returned: 0 in 0.345s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:20 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-86816736-0825-4264-b28e-545c63bf126e tempest-ProjectMemberTests-1245199771 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.info is being set with open permissions: ugo+rw Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86816736-0825-4264-b28e-545c63bf126e tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:20 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.info Jul 13 20:50:20 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:20 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:50:20 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:20 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9 Jul 13 20:50:20 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:20 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86816736-0825-4264-b28e-545c63bf126e tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.info" returned: 0 in 0.304s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-86816736-0825-4264-b28e-545c63bf126e tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.581s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-86816736-0825-4264-b28e-545c63bf126e tempest-ProjectMemberTests-1245199771 None] Create snapshot completed successfully Jul 13 20:50:20 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.356s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:50:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] Deleted volume successfully. Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a9dcc7ed-ee4f-4d0f-a540-2d55e8822893 tempest-ProjectReaderTests-1209755707 None] Lock "cinder-dc1c07f3-1bfe-447f-81bb-a0ebb1c47680-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:20 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9" returned: 0 in 0.649s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:20 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9 Jul 13 20:50:20 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:50:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Flow 'volume_create_manager' (a140a545-9dbc-4fc1-b840-01d67e49119f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3406165f-d9f0-4bc1-9343-60273f84abb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3406165f-d9f0-4bc1-9343-60273f84abb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1896287241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6a2b131-6b91-47d8-8f9b-826ac013fcdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b25f270ebf466ba7daf7f1233af4a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:21Z,use_quota=True,user_id='d453da7044e14137b28d642f5b01803d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e7c47b-1455-48d9-82c4-7e032c82ed94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e7c47b-1455-48d9-82c4-7e032c82ed94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65076d9b-8973-4b5c-b736-f912d9f954a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65076d9b-8973-4b5c-b736-f912d9f954a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6a2b131-6b91-47d8-8f9b-826ac013fcdf', 'volume_name': 'volume-e6a2b131-6b91-47d8-8f9b-826ac013fcdf', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8d9214-4f8d-4c1b-9e38-900ca5cf5dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8d9214-4f8d-4c1b-9e38-900ca5cf5dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab24c92-73c8-4eea-88a0-0dd33fce0526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:21 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Volume e6a2b131-6b91-47d8-8f9b-826ac013fcdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6a2b131-6b91-47d8-8f9b-826ac013fcdf', 'volume_size': 1} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1896287241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6a2b131-6b91-47d8-8f9b-826ac013fcdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b25f270ebf466ba7daf7f1233af4a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:21Z,use_quota=True,user_id='d453da7044e14137b28d642f5b01803d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Creating volume e6a2b131-6b91-47d8-8f9b-826ac013fcdf {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:50:21 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e6a2b131-6b91-47d8-8f9b-826ac013fcdf 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:21 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e6a2b131-6b91-47d8-8f9b-826ac013fcdf 1073741824 Jul 13 20:50:21 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-4a2532e3-ae99-4c2b-bc70-2e62ea809114-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] Lock "cinder-4a2532e3-ae99-4c2b-bc70-2e62ea809114-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:21 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-8dbc3742-5a3a-4cd5-acec-bc41530a8168" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79c3f52c-8941-4e64-8d83-2d01657f3ff9" returned: 0 in 0.416s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-8dbc3742-5a3a-4cd5-acec-bc41530a8168" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-4a2532e3-ae99-4c2b-bc70-2e62ea809114" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-79c3f52c-8941-4e64-8d83-2d01657f3ff9" released by "delete_volume" :: held 1.165s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-4a2532e3-ae99-4c2b-bc70-2e62ea809114" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] Deleting offline snapshot 4a2532e3-ae99-4c2b-bc70-2e62ea809114 of volume 8dbc3742-5a3a-4cd5-acec-bc41530a8168 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] snapshot_file for this snap is: volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd4160d-0283-4b84-b460-24b5bc48d37c]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] Created reservations ['a5273bf8-050f-4b22-b3cb-d77f22113f66', 'a2e13e0d-a60a-4f01-9556-c760953abe4a', 'd4a71a26-be2d-44cb-9652-d50b0be71651', '4f3756fc-53f9-49e2-905f-3f87e99720af'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:21 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114 Jul 13 20:50:21 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:21 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:50:21 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:21 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e6a2b131-6b91-47d8-8f9b-826ac013fcdf 1073741824" returned: 0 in 0.610s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e6a2b131-6b91-47d8-8f9b-826ac013fcdf {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:21 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e6a2b131-6b91-47d8-8f9b-826ac013fcdf Jul 13 20:50:21 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:21 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114" returned: 0 in 0.495s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:50:21 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f702642a-0a7c-40fe-b5a6-acaca1382fd4]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:21 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] Deleted volume successfully. Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f60b023a-7446-4002-bbae-e687c71200ec tempest-ProjectReaderTests-896704004 None] Lock "cinder-79c3f52c-8941-4e64-8d83-2d01657f3ff9-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:22 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168 Jul 13 20:50:22 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:22 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e6a2b131-6b91-47d8-8f9b-826ac013fcdf" returned: 0 in 0.324s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab24c92-73c8-4eea-88a0-0dd33fce0526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6a2b131-6b91-47d8-8f9b-826ac013fcdf', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b333e25-f20b-47da-b514-98870ddbafe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:22 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Volume volume-e6a2b131-6b91-47d8-8f9b-826ac013fcdf (e6a2b131-6b91-47d8-8f9b-826ac013fcdf): created successfully Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b333e25-f20b-47da-b514-98870ddbafe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Flow 'volume_create_manager' (a140a545-9dbc-4fc1-b840-01d67e49119f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d70237a1-9309-440c-9c71-ca4101aff738 tempest-ProjectReaderTests-1209755707 None] Created volume successfully. Jul 13 20:50:22 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168" returned: 0 in 0.441s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:22 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114 Jul 13 20:50:22 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:22 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114" returned: 0 in 0.429s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:22 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114 Jul 13 20:50:22 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Flow 'volume_create_manager' (a57ed638-ad97-46f0-8c0b-6c484c53f9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c831e66-4c12-4f92-bdec-9e835ddafc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c831e66-4c12-4f92-bdec-9e835ddafc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-193919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d1ba81b-61d6-4ba9-8723-945bac0888d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ad6530b4fd45b1b814e1b58730f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:23Z,use_quota=True,user_id='85687734f02f4a1a873b2b2a1c31ea8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1c71fb-5bf1-40e6-a2a5-6601bd3b9fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1c71fb-5bf1-40e6-a2a5-6601bd3b9fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7438ad2-5f64-4ccf-afc9-5a8dac7b1b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7438ad2-5f64-4ccf-afc9-5a8dac7b1b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d1ba81b-61d6-4ba9-8723-945bac0888d7', 'volume_name': 'volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4a3be1-8523-42cf-84ed-525f75ed3eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4a3be1-8523-42cf-84ed-525f75ed3eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca4c0a0-11de-4e66-a863-a64a19568a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:22 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Volume 2d1ba81b-61d6-4ba9-8723-945bac0888d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7', 'volume_size': 1} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-193919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d1ba81b-61d6-4ba9-8723-945bac0888d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ad6530b4fd45b1b814e1b58730f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:23Z,use_quota=True,user_id='85687734f02f4a1a873b2b2a1c31ea8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Creating volume 2d1ba81b-61d6-4ba9-8723-945bac0888d7 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:50:22 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:50:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:22 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7 1073741824 Jul 13 20:50:22 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:23 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] Acquiring lock "cinder-e6a2b131-6b91-47d8-8f9b-826ac013fcdf-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168.4a2532e3-ae99-4c2b-bc70-2e62ea809114" returned: 0 in 0.343s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] Lock "cinder-e6a2b131-6b91-47d8-8f9b-826ac013fcdf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-4a2532e3-ae99-4c2b-bc70-2e62ea809114" released by "_delete_snapshot" :: held 1.899s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-8dbc3742-5a3a-4cd5-acec-bc41530a8168" released by "delete_snapshot" :: held 1.936s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] Acquiring lock "cinder-quobyte-e6a2b131-6b91-47d8-8f9b-826ac013fcdf" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] Lock "cinder-quobyte-e6a2b131-6b91-47d8-8f9b-826ac013fcdf" acquired by "delete_volume" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c19c13-ce85-4e44-90a2-e74379ac6224]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e6a2b131-6b91-47d8-8f9b-826ac013fcdf {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] Created reservations ['9985ab31-f0c3-4467-8266-f0673b3380ec', '9dca9164-9a90-4ab8-a801-eeb0fa8ba0f3', '7991ae95-f1de-4ab1-83f2-7d514169d6b9', 'ab9bd6c7-3615-466c-9f5b-09f1fdf14518'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:23 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] Delete snapshot completed successfully. Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3c56bb09-f166-4f7f-b84e-3060ced1ac9e tempest-ProjectMemberTests-1245199771 None] Lock "cinder-4a2532e3-ae99-4c2b-bc70-2e62ea809114-delete_snapshot" released by "delete_snapshot" :: held 2.176s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:23 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e6a2b131-6b91-47d8-8f9b-826ac013fcdf Jul 13 20:50:23 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:23 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7 1073741824" returned: 0 in 0.526s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:23 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7 Jul 13 20:50:23 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:23 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e6a2b131-6b91-47d8-8f9b-826ac013fcdf" returned: 0 in 0.426s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e6a2b131-6b91-47d8-8f9b-826ac013fcdf {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:23 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e6a2b131-6b91-47d8-8f9b-826ac013fcdf Jul 13 20:50:23 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:23 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7" returned: 0 in 0.286s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca4c0a0-11de-4e66-a863-a64a19568a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764ab46e-492e-45c8-a074-f6f26c9943b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:23 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Volume volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7 (2d1ba81b-61d6-4ba9-8723-945bac0888d7): created successfully Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764ab46e-492e-45c8-a074-f6f26c9943b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Flow 'volume_create_manager' (a57ed638-ad97-46f0-8c0b-6c484c53f9d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:23 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-98046521-f520-4a85-a362-be57229b86ca tempest-ProjectReaderTests-896704004 None] Created volume successfully. Jul 13 20:50:23 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-e6a2b131-6b91-47d8-8f9b-826ac013fcdf" returned: 0 in 0.290s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] Lock "cinder-quobyte-e6a2b131-6b91-47d8-8f9b-826ac013fcdf" released by "delete_volume" :: held 0.769s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:24 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] Created reservations ['07fed923-327a-4d68-ae3b-262a81d3ec91', '0b35db2c-941f-43ff-b0b4-66319b6c0423', '2d1dc1d7-1183-4bff-83bd-a652ef6c61d2', 'b97e2c0e-f38b-428d-8cee-e106a37e84c4'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:24 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:50:24 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:24 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-8dbc3742-5a3a-4cd5-acec-bc41530a8168-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.298s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:24 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:50:24 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] Deleted volume successfully. Jul 13 20:50:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-8dbc3742-5a3a-4cd5-acec-bc41530a8168-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e14abe7-1a50-4e85-a6f2-cb88bdbaefe5 tempest-ProjectReaderTests-1209755707 None] Lock "cinder-e6a2b131-6b91-47d8-8f9b-826ac013fcdf-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-8dbc3742-5a3a-4cd5-acec-bc41530a8168" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-8dbc3742-5a3a-4cd5-acec-bc41530a8168" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20ea099-af6c-4de4-b602-39ea2fd504c4]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:24 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168 Jul 13 20:50:24 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Flow 'volume_create_manager' (576ea184-acc3-405c-ba52-0419deeebd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4cf0667-73d9-450e-bb9a-88d31ea4c577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:25 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4cf0667-73d9-450e-bb9a-88d31ea4c577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-543753871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab312a65-cc59-45c5-a71a-799fe6c85da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b25f270ebf466ba7daf7f1233af4a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:25Z,use_quota=True,user_id='d453da7044e14137b28d642f5b01803d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c980e9-ff2e-44d1-9c96-2019d96f8e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c980e9-ff2e-44d1-9c96-2019d96f8e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421e5a65-15dc-4dd1-bfa9-cb90f3fdb363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421e5a65-15dc-4dd1-bfa9-cb90f3fdb363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab312a65-cc59-45c5-a71a-799fe6c85da8', 'volume_name': 'volume-ab312a65-cc59-45c5-a71a-799fe6c85da8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cefdf2bf-0214-47db-a245-555dba12bbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cefdf2bf-0214-47db-a245-555dba12bbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4097f16d-3e11-41b2-8f9f-bde25ba92815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:25 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Volume ab312a65-cc59-45c5-a71a-799fe6c85da8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab312a65-cc59-45c5-a71a-799fe6c85da8', 'volume_size': 1} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-543753871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab312a65-cc59-45c5-a71a-799fe6c85da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b25f270ebf466ba7daf7f1233af4a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:25Z,use_quota=True,user_id='d453da7044e14137b28d642f5b01803d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Creating volume ab312a65-cc59-45c5-a71a-799fe6c85da8 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:50:25 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ab312a65-cc59-45c5-a71a-799fe6c85da8 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168" returned: 0 in 0.569s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:25 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ab312a65-cc59-45c5-a71a-799fe6c85da8 1073741824 Jul 13 20:50:25 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ac3bc404-94d3-41d8-9bb2-6aba22228d2b tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:25 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168 Jul 13 20:50:25 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:25 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-8dbc3742-5a3a-4cd5-acec-bc41530a8168" returned: 0 in 0.400s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-8dbc3742-5a3a-4cd5-acec-bc41530a8168" released by "delete_volume" :: held 1.068s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] Created reservations ['1263f012-a737-467b-8eac-f340847d9ad0', 'c9a59768-7a49-43fc-b6b0-79f96ab1cbd8', '09627825-4f37-4ebb-b942-e0726d7d2905', 'd7ddd6b5-a00a-4a33-a407-8959ba92b88b'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:25 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ab312a65-cc59-45c5-a71a-799fe6c85da8 1073741824" returned: 0 in 0.601s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:25 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:50:25 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ab312a65-cc59-45c5-a71a-799fe6c85da8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:25 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ab312a65-cc59-45c5-a71a-799fe6c85da8 Jul 13 20:50:25 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:26 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.302s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:50:26 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] Deleted volume successfully. Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-68bf07f8-21ef-4c4b-ab2f-a627352adc54 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-8dbc3742-5a3a-4cd5-acec-bc41530a8168-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:26 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ab312a65-cc59-45c5-a71a-799fe6c85da8" returned: 0 in 0.300s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ac3bc404-94d3-41d8-9bb2-6aba22228d2b tempest-ProjectReaderTests-896704004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.896s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4097f16d-3e11-41b2-8f9f-bde25ba92815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab312a65-cc59-45c5-a71a-799fe6c85da8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428fc7e8-e4d7-4ba3-b308-6732bb0e8bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ac3bc404-94d3-41d8-9bb2-6aba22228d2b tempest-ProjectReaderTests-896704004 None] Creating offline snapshot 4d8571c2-b4d2-4123-98cb-03f77a8cfab7 of volume 2d1ba81b-61d6-4ba9-8723-945bac0888d7 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:50:26 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Volume volume-ab312a65-cc59-45c5-a71a-799fe6c85da8 (ab312a65-cc59-45c5-a71a-799fe6c85da8): created successfully Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428fc7e8-e4d7-4ba3-b308-6732bb0e8bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Flow 'volume_create_manager' (576ea184-acc3-405c-ba52-0419deeebd44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[802632b6-25ff-4c16-bdcb-dcdc6ae7b7ef]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac3bc404-94d3-41d8-9bb2-6aba22228d2b tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:26 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b470f740-b2c4-443f-8111-13dd61eab282 tempest-ProjectReaderTests-1209755707 None] Created volume successfully. Jul 13 20:50:26 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7 Jul 13 20:50:26 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:26 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac3bc404-94d3-41d8-9bb2-6aba22228d2b tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7" returned: 0 in 0.389s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac3bc404-94d3-41d8-9bb2-6aba22228d2b tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:26 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7 1G Jul 13 20:50:26 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Flow 'volume_create_manager' (8b06e89d-401e-4122-9f3f-7722ecc5fb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48ca784-a178-460f-b6fe-e7ce1af0a2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48ca784-a178-460f-b6fe-e7ce1af0a2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1142193813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01162e9-1335-4d99-bd25-643b326ce242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c65a16cce64172a65e30474137adcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:27Z,use_quota=True,user_id='90da4dd046cb4da0a3312ab6a437f2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974cca28-5390-4e4a-8a23-c187610d8acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974cca28-5390-4e4a-8a23-c187610d8acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8802c2c0-f506-41a7-b983-d6199418bb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8802c2c0-f506-41a7-b983-d6199418bb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b01162e9-1335-4d99-bd25-643b326ce242', 'volume_name': 'volume-b01162e9-1335-4d99-bd25-643b326ce242', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd622389-23b7-4c80-9573-83bd05245c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd622389-23b7-4c80-9573-83bd05245c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22746a9e-3e9b-43d6-bd04-f052981cbac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:26 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Volume b01162e9-1335-4d99-bd25-643b326ce242: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b01162e9-1335-4d99-bd25-643b326ce242', 'volume_size': 1} Jul 13 20:50:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:27 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac3bc404-94d3-41d8-9bb2-6aba22228d2b tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7 1G" returned: 0 in 0.487s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac3bc404-94d3-41d8-9bb2-6aba22228d2b tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:27 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7 Jul 13 20:50:27 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] Acquiring lock "cinder-ab312a65-cc59-45c5-a71a-799fe6c85da8-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] Lock "cinder-ab312a65-cc59-45c5-a71a-799fe6c85da8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] Acquiring lock "cinder-quobyte-ab312a65-cc59-45c5-a71a-799fe6c85da8" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] Lock "cinder-quobyte-ab312a65-cc59-45c5-a71a-799fe6c85da8" acquired by "delete_volume" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Flow 'volume_create_manager' (27afbc8d-2590-45e7-b98c-85e3ccf5da9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f96f02-e0f4-4bf5-9992-ebe52095de6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[029c701a-1751-41b7-bd8c-cc66208f6e0d]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ab312a65-cc59-45c5-a71a-799fe6c85da8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f96f02-e0f4-4bf5-9992-ebe52095de6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-809427327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7369459c-3882-48c3-bc96-3d74746fbd8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c38df1850474d9a82d8fc73b3b0553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:27Z,use_quota=True,user_id='ffe1c94cc7714b9b8648f410124784e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:27 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e5fa0e-3e47-457d-b7f2-02fbcb475bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e5fa0e-3e47-457d-b7f2-02fbcb475bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d21976-f7a9-42d6-8409-1fb783391aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d21976-f7a9-42d6-8409-1fb783391aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7369459c-3882-48c3-bc96-3d74746fbd8b', 'volume_name': 'volume-7369459c-3882-48c3-bc96-3d74746fbd8b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7299c890-585a-478c-ad5f-e238d11855de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7299c890-585a-478c-ad5f-e238d11855de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c3b143-727f-497f-97d5-8c352a333f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:27 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Volume 7369459c-3882-48c3-bc96-3d74746fbd8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7369459c-3882-48c3-bc96-3d74746fbd8b', 'volume_size': 1} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac3bc404-94d3-41d8-9bb2-6aba22228d2b tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7" returned: 0 in 0.373s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:27 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-ac3bc404-94d3-41d8-9bb2-6aba22228d2b tempest-ProjectReaderTests-896704004 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7 is being set with open permissions: ugo+rw Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac3bc404-94d3-41d8-9bb2-6aba22228d2b tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:27 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7 Jul 13 20:50:27 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:27 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ab312a65-cc59-45c5-a71a-799fe6c85da8 Jul 13 20:50:27 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:27 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac3bc404-94d3-41d8-9bb2-6aba22228d2b tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7" returned: 0 in 0.250s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac3bc404-94d3-41d8-9bb2-6aba22228d2b tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:27 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.info Jul 13 20:50:27 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:27 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ab312a65-cc59-45c5-a71a-799fe6c85da8" returned: 0 in 0.379s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ab312a65-cc59-45c5-a71a-799fe6c85da8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:27 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ab312a65-cc59-45c5-a71a-799fe6c85da8 Jul 13 20:50:27 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:27 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac3bc404-94d3-41d8-9bb2-6aba22228d2b tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.info" returned: 0 in 0.258s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:27 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-ac3bc404-94d3-41d8-9bb2-6aba22228d2b tempest-ProjectReaderTests-896704004 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.info is being set with open permissions: ugo+rw Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac3bc404-94d3-41d8-9bb2-6aba22228d2b tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:27 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.info Jul 13 20:50:27 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:27 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ab312a65-cc59-45c5-a71a-799fe6c85da8" returned: 0 in 0.251s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] Lock "cinder-quobyte-ab312a65-cc59-45c5-a71a-799fe6c85da8" released by "delete_volume" :: held 0.694s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] Created reservations ['4e1c917d-90dc-480c-930b-5155e49f1d47', 'd91f2a0e-8e23-4a1a-bc4f-f47ec3367bc6', '86ca4ae7-cb73-484a-9dc5-f89a9cfc293d', 'cafd64e1-a723-41c6-b597-88a3791d902d'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:28 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:50:28 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:28 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac3bc404-94d3-41d8-9bb2-6aba22228d2b tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.info" returned: 0 in 0.251s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ac3bc404-94d3-41d8-9bb2-6aba22228d2b tempest-ProjectReaderTests-896704004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.118s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.291s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1142193813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01162e9-1335-4d99-bd25-643b326ce242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c65a16cce64172a65e30474137adcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:27Z,use_quota=True,user_id='90da4dd046cb4da0a3312ab6a437f2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Creating volume b01162e9-1335-4d99-bd25-643b326ce242 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:50:28 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:28 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 1073741824 Jul 13 20:50:28 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ac3bc404-94d3-41d8-9bb2-6aba22228d2b tempest-ProjectReaderTests-896704004 None] Create snapshot completed successfully Jul 13 20:50:28 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.282s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:50:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] Deleted volume successfully. Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-30bbe95a-4ad0-444d-937e-7148640d905e tempest-ProjectReaderTests-1209755707 None] Lock "cinder-ab312a65-cc59-45c5-a71a-799fe6c85da8-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:28 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 1073741824" returned: 0 in 0.459s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:28 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 Jul 13 20:50:28 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Flow 'volume_create_manager' (7d0511b2-12ea-4fea-bc58-31bde6206e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7426f7dd-59c6-4767-b766-98158d10a640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7426f7dd-59c6-4767-b766-98158d10a640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1598141901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faeb68d3-4ac4-4337-9509-fd37c32dcbd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b25f270ebf466ba7daf7f1233af4a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:29Z,use_quota=True,user_id='d453da7044e14137b28d642f5b01803d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e9b9f8-5203-4ea1-976c-eadcf4d0ea52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e9b9f8-5203-4ea1-976c-eadcf4d0ea52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9a2a54-2b3d-4b8b-8622-bc50214bbc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9a2a54-2b3d-4b8b-8622-bc50214bbc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faeb68d3-4ac4-4337-9509-fd37c32dcbd8', 'volume_name': 'volume-faeb68d3-4ac4-4337-9509-fd37c32dcbd8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9a06d1-40dc-4fad-80a2-d0df322b97e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9a06d1-40dc-4fad-80a2-d0df322b97e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce3879c-7277-425a-be94-308a853d05c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:28 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Volume faeb68d3-4ac4-4337-9509-fd37c32dcbd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faeb68d3-4ac4-4337-9509-fd37c32dcbd8', 'volume_size': 1} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:28 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242" returned: 0 in 0.262s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:50:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.593s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-809427327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7369459c-3882-48c3-bc96-3d74746fbd8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c38df1850474d9a82d8fc73b3b0553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:27Z,use_quota=True,user_id='ffe1c94cc7714b9b8648f410124784e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Creating volume 7369459c-3882-48c3-bc96-3d74746fbd8b {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:50:29 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22746a9e-3e9b-43d6-bd04-f052981cbac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b01162e9-1335-4d99-bd25-643b326ce242', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:29 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b 1073741824 Jul 13 20:50:29 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02b28b2-efcc-40fe-83c7-d5ae7b2fd8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:29 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Volume volume-b01162e9-1335-4d99-bd25-643b326ce242 (b01162e9-1335-4d99-bd25-643b326ce242): created successfully Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02b28b2-efcc-40fe-83c7-d5ae7b2fd8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Flow 'volume_create_manager' (8b06e89d-401e-4122-9f3f-7722ecc5fb10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:29 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c5234c66-0de9-4560-89a8-ca5cbe550d9d tempest-SnapshotDependencyTests-160339006 None] Created volume successfully. Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-4d8571c2-b4d2-4123-98cb-03f77a8cfab7-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] Lock "cinder-4d8571c2-b4d2-4123-98cb-03f77a8cfab7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-quobyte-2d1ba81b-61d6-4ba9-8723-945bac0888d7" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-2d1ba81b-61d6-4ba9-8723-945bac0888d7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-quobyte-4d8571c2-b4d2-4123-98cb-03f77a8cfab7" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-4d8571c2-b4d2-4123-98cb-03f77a8cfab7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] Deleting offline snapshot 4d8571c2-b4d2-4123-98cb-03f77a8cfab7 of volume 2d1ba81b-61d6-4ba9-8723-945bac0888d7 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] snapshot_file for this snap is: volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23df058-715e-4afd-976b-03747fad3449]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:29 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b 1073741824" returned: 0 in 0.453s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:29 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7 Jul 13 20:50:29 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:29 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b Jul 13 20:50:29 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:29 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b" returned: 0 in 0.242s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.845s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1598141901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faeb68d3-4ac4-4337-9509-fd37c32dcbd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b25f270ebf466ba7daf7f1233af4a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:29Z,use_quota=True,user_id='d453da7044e14137b28d642f5b01803d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Creating volume faeb68d3-4ac4-4337-9509-fd37c32dcbd8 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:50:29 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-faeb68d3-4ac4-4337-9509-fd37c32dcbd8 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c3b143-727f-497f-97d5-8c352a333f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7369459c-3882-48c3-bc96-3d74746fbd8b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:29 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5df98f-362c-4376-8d30-ca5af9609d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:29 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-faeb68d3-4ac4-4337-9509-fd37c32dcbd8 1073741824 Jul 13 20:50:29 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7" returned: 0 in 0.389s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[49408166-b169-477f-9175-7c5fd830a634]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:29 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Volume volume-7369459c-3882-48c3-bc96-3d74746fbd8b (7369459c-3882-48c3-bc96-3d74746fbd8b): created successfully Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5df98f-362c-4376-8d30-ca5af9609d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Flow 'volume_create_manager' (27afbc8d-2590-45e7-b98c-85e3ccf5da9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:29 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-81fce2b2-0a9a-44d5-bd7d-97d8032a4bd1 tempest-ProjectMemberTests-1245199771 None] Created volume successfully. Jul 13 20:50:29 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7 Jul 13 20:50:29 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:30 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7" returned: 0 in 0.443s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:30 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-faeb68d3-4ac4-4337-9509-fd37c32dcbd8 1073741824" returned: 0 in 0.527s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17369d5d-4da4-4e71-981c-3d5099b7f548 tempest-SnapshotDependencyTests-160339006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:30 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7 Jul 13 20:50:30 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-faeb68d3-4ac4-4337-9509-fd37c32dcbd8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:30 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-faeb68d3-4ac4-4337-9509-fd37c32dcbd8 Jul 13 20:50:30 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7c7a40a7-f081-41d6-a393-29b5c35c4b3c tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:30 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-faeb68d3-4ac4-4337-9509-fd37c32dcbd8" returned: 0 in 0.303s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17369d5d-4da4-4e71-981c-3d5099b7f548 tempest-SnapshotDependencyTests-160339006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.341s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce3879c-7277-425a-be94-308a853d05c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faeb68d3-4ac4-4337-9509-fd37c32dcbd8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ccd30f-bb1f-4f6a-b3c9-70651e6aa510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:30 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-17369d5d-4da4-4e71-981c-3d5099b7f548 tempest-SnapshotDependencyTests-160339006 None] Creating offline snapshot 8108e1da-eb98-4504-aaf0-68568709b6d2 of volume b01162e9-1335-4d99-bd25-643b326ce242 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7" returned: 0 in 0.406s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15287c8-2214-46e4-b964-f12786b76fa0]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17369d5d-4da4-4e71-981c-3d5099b7f548 tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:30 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7 Jul 13 20:50:30 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:30 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Volume volume-faeb68d3-4ac4-4337-9509-fd37c32dcbd8 (faeb68d3-4ac4-4337-9509-fd37c32dcbd8): created successfully Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ccd30f-bb1f-4f6a-b3c9-70651e6aa510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Flow 'volume_create_manager' (7d0511b2-12ea-4fea-bc58-31bde6206e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-17249aa1-0390-48e4-9917-a55a18c6319b tempest-ProjectReaderTests-1209755707 None] Created volume successfully. Jul 13 20:50:30 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 Jul 13 20:50:30 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] Acquiring lock "cinder-faeb68d3-4ac4-4337-9509-fd37c32dcbd8-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:30 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7.4d8571c2-b4d2-4123-98cb-03f77a8cfab7" returned: 0 in 0.259s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] Lock "cinder-faeb68d3-4ac4-4337-9509-fd37c32dcbd8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-4d8571c2-b4d2-4123-98cb-03f77a8cfab7" released by "_delete_snapshot" :: held 1.611s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-2d1ba81b-61d6-4ba9-8723-945bac0888d7" released by "delete_snapshot" :: held 1.638s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] Acquiring lock "cinder-quobyte-faeb68d3-4ac4-4337-9509-fd37c32dcbd8" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] Lock "cinder-quobyte-faeb68d3-4ac4-4337-9509-fd37c32dcbd8" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[62df4d00-add6-4c47-bef5-a47f5bee171d]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-faeb68d3-4ac4-4337-9509-fd37c32dcbd8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:31 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17369d5d-4da4-4e71-981c-3d5099b7f548 tempest-SnapshotDependencyTests-160339006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242" returned: 0 in 0.402s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17369d5d-4da4-4e71-981c-3d5099b7f548 tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] Created reservations ['df0c1004-32f8-49b6-9bf0-518812b48a22', 'd06ff5d9-9303-4058-b748-5a2d1700649f', 'fcb660af-d18b-4207-9628-46b0281691e4', 'a46df8ff-51cd-460d-b54d-36a5be8a17a8'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:31 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2 1G Jul 13 20:50:31 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:31 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] Delete snapshot completed successfully. Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d5202007-08ef-41bd-8ef5-a3d44d008b8b tempest-ProjectReaderTests-896704004 None] Lock "cinder-4d8571c2-b4d2-4123-98cb-03f77a8cfab7-delete_snapshot" released by "delete_snapshot" :: held 1.840s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:31 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-faeb68d3-4ac4-4337-9509-fd37c32dcbd8 Jul 13 20:50:31 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:31 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-faeb68d3-4ac4-4337-9509-fd37c32dcbd8" returned: 0 in 0.391s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-faeb68d3-4ac4-4337-9509-fd37c32dcbd8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:31 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-faeb68d3-4ac4-4337-9509-fd37c32dcbd8 Jul 13 20:50:31 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-2d1ba81b-61d6-4ba9-8723-945bac0888d7-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] Lock "cinder-2d1ba81b-61d6-4ba9-8723-945bac0888d7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-quobyte-2d1ba81b-61d6-4ba9-8723-945bac0888d7" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-2d1ba81b-61d6-4ba9-8723-945bac0888d7" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:31 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17369d5d-4da4-4e71-981c-3d5099b7f548 tempest-SnapshotDependencyTests-160339006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2 1G" returned: 0 in 0.530s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17369d5d-4da4-4e71-981c-3d5099b7f548 tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01162e9-1335-4d99-bd25-643b326ce242 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9803f0a5-37fc-433d-bb9c-d59c32dbeaa3]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:31 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01162e9-1335-4d99-bd25-643b326ce242 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2 Jul 13 20:50:31 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:31 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-faeb68d3-4ac4-4337-9509-fd37c32dcbd8" returned: 0 in 0.289s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:31 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7 Jul 13 20:50:31 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] Lock "cinder-quobyte-faeb68d3-4ac4-4337-9509-fd37c32dcbd8" released by "delete_volume" :: held 0.728s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] Created reservations ['65ec74f5-dbd5-4c39-bfb7-8480592b3514', '63e3a28b-fdd2-44ad-8875-f70ac5b662d8', '1cec6335-e9f8-4cb1-b89b-474440ad50a5', 'db3bf846-977c-4261-a3a5-3ae748b639fa'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:31 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:50:31 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:31 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17369d5d-4da4-4e71-981c-3d5099b7f548 tempest-SnapshotDependencyTests-160339006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01162e9-1335-4d99-bd25-643b326ce242 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2" returned: 0 in 0.319s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:31 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-17369d5d-4da4-4e71-981c-3d5099b7f548 tempest-SnapshotDependencyTests-160339006 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2 is being set with open permissions: ugo+rw Jul 13 20:50:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17369d5d-4da4-4e71-981c-3d5099b7f548 tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:31 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2 Jul 13 20:50:31 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:32 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7" returned: 0 in 0.421s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:32 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7 Jul 13 20:50:32 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:32 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.289s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:50:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] Deleted volume successfully. Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-40d88edf-cf6c-4db2-857a-32fad54f9919 tempest-ProjectReaderTests-1209755707 None] Lock "cinder-faeb68d3-4ac4-4337-9509-fd37c32dcbd8-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:32 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17369d5d-4da4-4e71-981c-3d5099b7f548 tempest-SnapshotDependencyTests-160339006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2" returned: 0 in 0.302s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17369d5d-4da4-4e71-981c-3d5099b7f548 tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:32 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.info Jul 13 20:50:32 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:32 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-2d1ba81b-61d6-4ba9-8723-945bac0888d7" returned: 0 in 0.302s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-2d1ba81b-61d6-4ba9-8723-945bac0888d7" released by "delete_volume" :: held 0.795s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] Created reservations ['f4feb5a6-761e-4a41-a48f-5ae839d0e704', 'd4f2e863-6e6f-4014-8a16-6a5f7d281aa8', 'cabf6b85-9fda-43dd-82e8-19c6594b945e', '6eac8afb-0e70-40dd-a256-3f32b4f4b166'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:32 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:50:32 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:32 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17369d5d-4da4-4e71-981c-3d5099b7f548 tempest-SnapshotDependencyTests-160339006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.info" returned: 0 in 0.302s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:32 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-17369d5d-4da4-4e71-981c-3d5099b7f548 tempest-SnapshotDependencyTests-160339006 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.info is being set with open permissions: ugo+rw Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17369d5d-4da4-4e71-981c-3d5099b7f548 tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:32 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.info Jul 13 20:50:32 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:32 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.301s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:50:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] Deleted volume successfully. Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c89b8d1-c325-48ad-bdcf-2d9ffeb94883 tempest-ProjectReaderTests-896704004 None] Lock "cinder-2d1ba81b-61d6-4ba9-8723-945bac0888d7-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:32 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17369d5d-4da4-4e71-981c-3d5099b7f548 tempest-SnapshotDependencyTests-160339006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.info" returned: 0 in 0.318s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17369d5d-4da4-4e71-981c-3d5099b7f548 tempest-SnapshotDependencyTests-160339006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.292s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7c7a40a7-f081-41d6-a393-29b5c35c4b3c tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.389s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7c7a40a7-f081-41d6-a393-29b5c35c4b3c tempest-ProjectMemberTests-1245199771 None] Creating offline snapshot a84f2341-4c0f-48ce-a9d4-ed8416cf25e2 of volume 7369459c-3882-48c3-bc96-3d74746fbd8b {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:50:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-17369d5d-4da4-4e71-981c-3d5099b7f548 tempest-SnapshotDependencyTests-160339006 None] Create snapshot completed successfully Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30d11e5-46b6-480d-b70d-6a94328bebe0]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7a40a7-f081-41d6-a393-29b5c35c4b3c tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:33 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b Jul 13 20:50:33 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:33 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:50:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Flow 'volume_create_manager' (ab5b6b48-0fa3-4119-a3dd-56652058de94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25708e34-5035-4040-bdeb-57297febe587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25708e34-5035-4040-bdeb-57297febe587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1887635781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dfec267-fff3-4456-b55d-e3fcf9c2bffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ad6530b4fd45b1b814e1b58730f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:33Z,use_quota=True,user_id='85687734f02f4a1a873b2b2a1c31ea8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee83d089-d40f-4650-8764-aa4879e5103b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee83d089-d40f-4650-8764-aa4879e5103b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec926d2-b4fe-4da8-9cf6-9c428f7b7bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec926d2-b4fe-4da8-9cf6-9c428f7b7bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dfec267-fff3-4456-b55d-e3fcf9c2bffa', 'volume_name': 'volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5239b7ba-4d5d-4e20-861f-c2c221a60542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5239b7ba-4d5d-4e20-861f-c2c221a60542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05570d0-c4df-44d1-9d29-a67e19b1e084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:33 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Volume 3dfec267-fff3-4456-b55d-e3fcf9c2bffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa', 'volume_size': 1} Jul 13 20:50:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:33 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7a40a7-f081-41d6-a393-29b5c35c4b3c tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b" returned: 0 in 0.471s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7a40a7-f081-41d6-a393-29b5c35c4b3c tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:33 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2 1G Jul 13 20:50:33 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:33 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7a40a7-f081-41d6-a393-29b5c35c4b3c tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2 1G" returned: 0 in 0.497s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7a40a7-f081-41d6-a393-29b5c35c4b3c tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7369459c-3882-48c3-bc96-3d74746fbd8b -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:33 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7369459c-3882-48c3-bc96-3d74746fbd8b -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2 Jul 13 20:50:33 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:34 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:50:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Flow 'volume_create_manager' (5bf35549-4794-49b3-9a63-3c46d218c14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c873561a-be8a-4ea1-8ce4-af0dc32f5706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c873561a-be8a-4ea1-8ce4-af0dc32f5706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35df9250-5ee4-4078-8677-177073c241c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c65a16cce64172a65e30474137adcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8108e1da-eb98-4504-aaf0-68568709b6d2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:34Z,use_quota=True,user_id='90da4dd046cb4da0a3312ab6a437f2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394292c2-a973-446e-82ae-aa4e15b8a844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394292c2-a973-446e-82ae-aa4e15b8a844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b267ad-0ee1-4fce-b2f2-fd4e734ad058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b267ad-0ee1-4fce-b2f2-fd4e734ad058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '35df9250-5ee4-4078-8677-177073c241c7', 'volume_name': 'volume-35df9250-5ee4-4078-8677-177073c241c7', 'volume_size': 1, 'snapshot_id': '8108e1da-eb98-4504-aaf0-68568709b6d2'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78cb747-bc9f-4609-ac13-fec1cd554f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78cb747-bc9f-4609-ac13-fec1cd554f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ea47d8-1480-45bc-933a-a058ed03ad5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:34 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Volume 35df9250-5ee4-4078-8677-177073c241c7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-35df9250-5ee4-4078-8677-177073c241c7', 'volume_size': 1, 'snapshot_id': '8108e1da-eb98-4504-aaf0-68568709b6d2'} Jul 13 20:50:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:34 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7a40a7-f081-41d6-a393-29b5c35c4b3c tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7369459c-3882-48c3-bc96-3d74746fbd8b -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2" returned: 0 in 0.382s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:34 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-7c7a40a7-f081-41d6-a393-29b5c35c4b3c tempest-ProjectMemberTests-1245199771 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2 is being set with open permissions: ugo+rw Jul 13 20:50:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7a40a7-f081-41d6-a393-29b5c35c4b3c tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:34 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2 Jul 13 20:50:34 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:34 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7a40a7-f081-41d6-a393-29b5c35c4b3c tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2" returned: 0 in 0.250s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7a40a7-f081-41d6-a393-29b5c35c4b3c tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:34 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.info Jul 13 20:50:34 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:34 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7a40a7-f081-41d6-a393-29b5c35c4b3c tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.info" returned: 0 in 0.242s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:34 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-7c7a40a7-f081-41d6-a393-29b5c35c4b3c tempest-ProjectMemberTests-1245199771 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.info is being set with open permissions: ugo+rw Jul 13 20:50:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7a40a7-f081-41d6-a393-29b5c35c4b3c tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:34 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.info Jul 13 20:50:34 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:35 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7a40a7-f081-41d6-a393-29b5c35c4b3c tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.info" returned: 0 in 0.246s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7c7a40a7-f081-41d6-a393-29b5c35c4b3c tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.740s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1887635781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dfec267-fff3-4456-b55d-e3fcf9c2bffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ad6530b4fd45b1b814e1b58730f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:33Z,use_quota=True,user_id='85687734f02f4a1a873b2b2a1c31ea8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Creating volume 3dfec267-fff3-4456-b55d-e3fcf9c2bffa {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:50:35 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:35 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa 1073741824 Jul 13 20:50:35 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:35 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7c7a40a7-f081-41d6-a393-29b5c35c4b3c tempest-ProjectMemberTests-1245199771 None] Create snapshot completed successfully Jul 13 20:50:35 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa 1073741824" returned: 0 in 0.425s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:35 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa Jul 13 20:50:35 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-a84f2341-4c0f-48ce-a9d4-ed8416cf25e2-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-a84f2341-4c0f-48ce-a9d4-ed8416cf25e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-7369459c-3882-48c3-bc96-3d74746fbd8b" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-7369459c-3882-48c3-bc96-3d74746fbd8b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-a84f2341-4c0f-48ce-a9d4-ed8416cf25e2" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-a84f2341-4c0f-48ce-a9d4-ed8416cf25e2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] Deleting offline snapshot a84f2341-4c0f-48ce-a9d4-ed8416cf25e2 of volume 7369459c-3882-48c3-bc96-3d74746fbd8b {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] snapshot_file for this snap is: volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38ad70f-171e-415b-a540-7f1d04fa79d7]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:35 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa" returned: 0 in 0.263s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.590s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Acquiring lock "cinder-quobyte-8108e1da-eb98-4504-aaf0-68568709b6d2-35df9250-5ee4-4078-8677-177073c241c7" by "_create_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05570d0-c4df-44d1-9d29-a67e19b1e084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f93640-5743-4008-9c77-5fb770aa5c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Lock "cinder-quobyte-8108e1da-eb98-4504-aaf0-68568709b6d2-35df9250-5ee4-4078-8677-177073c241c7" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Creating volume 35df9250-5ee4-4078-8677-177073c241c7 from snapshot 8108e1da-eb98-4504-aaf0-68568709b6d2 {{(pid=87269) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Acquiring lock "cinder-quobyte-35df9250-5ee4-4078-8677-177073c241c7" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:35 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Volume volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa (3dfec267-fff3-4456-b55d-e3fcf9c2bffa): created successfully Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f93640-5743-4008-9c77-5fb770aa5c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Flow 'volume_create_manager' (ab5b6b48-0fa3-4119-a3dd-56652058de94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Lock "cinder-quobyte-35df9250-5ee4-4078-8677-177073c241c7" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] snapshot: 8108e1da-eb98-4504-aaf0-68568709b6d2, volume: 35df9250-5ee4-4078-8677-177073c241c7, {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 20:50:35 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d6904736-a837-4ea1-8d3b-07712262a5d9 tempest-ProjectReaderTests-896704004 None] Created volume successfully. Jul 13 20:50:35 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2 Jul 13 20:50:35 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c46b7c-b6ac-45fc-b41b-2d73a81b0229]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:36 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2 Jul 13 20:50:36 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:36 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2" returned: 0 in 0.382s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7369459c-3882-48c3-bc96-3d74746fbd8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:50:36 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a51c53-1ff8-4f85-a456-72e19e6be2c3]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:36 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b Jul 13 20:50:36 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:36 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2" returned: 0 in 0.397s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b01162e9-1335-4d99-bd25-643b326ce242(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:50:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 20:50:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 20:50:36 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb31c64-b375-48e7-a274-17d05859b252]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:36 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 Jul 13 20:50:36 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:36 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b" returned: 0 in 0.395s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:36 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2 Jul 13 20:50:36 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a6f183f1-3b29-4e96-b790-f3d5639b4c41 tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:36 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242" returned: 0 in 0.436s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:36 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Path /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-35df9250-5ee4-4078-8677-177073c241c7 not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 20:50:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-35df9250-5ee4-4078-8677-177073c241c7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:36 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-35df9250-5ee4-4078-8677-177073c241c7 Jul 13 20:50:36 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:36 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2" returned: 0 in 0.335s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:37 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2 Jul 13 20:50:37 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:37 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b.a84f2341-4c0f-48ce-a9d4-ed8416cf25e2" returned: 0 in 0.251s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-a84f2341-4c0f-48ce-a9d4-ed8416cf25e2" released by "_delete_snapshot" :: held 1.478s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-7369459c-3882-48c3-bc96-3d74746fbd8b" released by "delete_snapshot" :: held 1.501s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:37 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] Created reservations ['48c4087a-e9c1-4b7a-91f6-afade6c12eea', 'f2573a8f-2d55-4281-9c4f-acb36569dd07', '25d37d3d-a00f-47f1-a7d7-1e96aa55c67c', '40c42f4d-116e-4878-8ebc-fd00b2b2e547'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:37 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] Delete snapshot completed successfully. Jul 13 20:50:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0c3bd0ac-0424-4098-9a28-e33fae54fc45 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-a84f2341-4c0f-48ce-a9d4-ed8416cf25e2-delete_snapshot" released by "delete_snapshot" :: held 1.743s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-7369459c-3882-48c3-bc96-3d74746fbd8b-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] Lock "cinder-7369459c-3882-48c3-bc96-3d74746fbd8b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-7369459c-3882-48c3-bc96-3d74746fbd8b" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-7369459c-3882-48c3-bc96-3d74746fbd8b" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:38 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf01872-c8bd-439e-ab92-f060ad53ff06]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:38 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b Jul 13 20:50:38 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:39 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b" returned: 0 in 0.659s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:39 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b Jul 13 20:50:39 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:39 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7369459c-3882-48c3-bc96-3d74746fbd8b" returned: 0 in 0.623s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-7369459c-3882-48c3-bc96-3d74746fbd8b" released by "delete_volume" :: held 1.429s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:39 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] Created reservations ['2448fb1d-7da8-4c08-9491-2d81fd03d4d1', '5ae7a51f-b073-40d4-9089-9a81f218183f', '4c6c6fba-3356-4370-8d9e-497416c24227', '0a629dfd-a241-4795-85ff-f9d2bf207b55'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:40 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:50:40 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:40 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:40 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:50:40 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] Deleted volume successfully. Jul 13 20:50:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cdb83f98-e20e-4484-8a8e-d0cda371217f tempest-ProjectMemberTests-1245199771 None] Lock "cinder-7369459c-3882-48c3-bc96-3d74746fbd8b-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:41 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-35df9250-5ee4-4078-8677-177073c241c7" returned: 0 in 4.605s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:41 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[407ed919-a51a-4fe0-a6b1-ede4c229e930]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:41 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 Jul 13 20:50:41 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:41 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:50:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Flow 'volume_create_manager' (39c2d427-9a3d-40dd-bf79-4e9259001228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb62ff4-e1d2-497b-bde9-0bc87bc213f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb62ff4-e1d2-497b-bde9-0bc87bc213f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-771942382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7efff2-8483-417f-923b-f02ac7a5eb69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c38df1850474d9a82d8fc73b3b0553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:42Z,use_quota=True,user_id='ffe1c94cc7714b9b8648f410124784e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337af00c-fca8-4156-91b0-173b1f3215b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337af00c-fca8-4156-91b0-173b1f3215b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc5ee305-68a6-475f-ae89-71143d291558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc5ee305-68a6-475f-ae89-71143d291558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c7efff2-8483-417f-923b-f02ac7a5eb69', 'volume_name': 'volume-7c7efff2-8483-417f-923b-f02ac7a5eb69', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25aec928-4ccd-40ac-957c-0e58c1062074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25aec928-4ccd-40ac-957c-0e58c1062074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6141305-7f7d-44a6-8778-13f4e9799890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:41 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Volume 7c7efff2-8483-417f-923b-f02ac7a5eb69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c7efff2-8483-417f-923b-f02ac7a5eb69', 'volume_size': 1} Jul 13 20:50:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:41 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242" returned: 0 in 0.520s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:41 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242, size 1024.00 MB, duration 4.61 sec, destination /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-35df9250-5ee4-4078-8677-177073c241c7 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 20:50:41 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Converted 1024.00 MB image at 222.28 MB/s Jul 13 20:50:41 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-35df9250-5ee4-4078-8677-177073c241c7 is being set with open permissions: ugo+rw Jul 13 20:50:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-35df9250-5ee4-4078-8677-177073c241c7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:42 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-35df9250-5ee4-4078-8677-177073c241c7 Jul 13 20:50:42 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:42 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-35df9250-5ee4-4078-8677-177073c241c7" returned: 0 in 0.239s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Lock "cinder-quobyte-35df9250-5ee4-4078-8677-177073c241c7" released by "_copy_volume_from_snapshot" :: held 6.299s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Lock "cinder-quobyte-8108e1da-eb98-4504-aaf0-68568709b6d2-35df9250-5ee4-4078-8677-177073c241c7" released by "_create_volume_from_snapshot" :: held 6.353s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.388s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a6f183f1-3b29-4e96-b790-f3d5639b4c41 tempest-ProjectReaderTests-896704004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.447s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a6f183f1-3b29-4e96-b790-f3d5639b4c41 tempest-ProjectReaderTests-896704004 None] Creating offline snapshot 575a8df5-db00-4bf1-ae66-f356fe99c1cb of volume 3dfec267-fff3-4456-b55d-e3fcf9c2bffa {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d099df-e1dd-4803-8171-df6f69ff786b]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a6f183f1-3b29-4e96-b790-f3d5639b4c41 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ea47d8-1480-45bc-933a-a058ed03ad5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35df9250-5ee4-4078-8677-177073c241c7', 'volume_size': 1, 'snapshot_id': '8108e1da-eb98-4504-aaf0-68568709b6d2'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76af167-cd57-4019-85c6-f61d076ae833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:42 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Volume volume-35df9250-5ee4-4078-8677-177073c241c7 (35df9250-5ee4-4078-8677-177073c241c7): created successfully Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76af167-cd57-4019-85c6-f61d076ae833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Flow 'volume_create_manager' (5bf35549-4794-49b3-9a63-3c46d218c14f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:42 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3fb9f36b-c9af-4c85-a364-45bf9fe59871 tempest-SnapshotDependencyTests-160339006 None] Created volume successfully. Jul 13 20:50:42 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa Jul 13 20:50:42 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:42 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a6f183f1-3b29-4e96-b790-f3d5639b4c41 tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa" returned: 0 in 0.364s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a6f183f1-3b29-4e96-b790-f3d5639b4c41 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:42 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb 1G Jul 13 20:50:42 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] Acquiring lock "cinder-8108e1da-eb98-4504-aaf0-68568709b6d2-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] Lock "cinder-8108e1da-eb98-4504-aaf0-68568709b6d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] Acquiring lock "cinder-quobyte-b01162e9-1335-4d99-bd25-643b326ce242" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] Lock "cinder-quobyte-b01162e9-1335-4d99-bd25-643b326ce242" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] Acquiring lock "cinder-quobyte-8108e1da-eb98-4504-aaf0-68568709b6d2" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] Lock "cinder-quobyte-8108e1da-eb98-4504-aaf0-68568709b6d2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] Deleting offline snapshot 8108e1da-eb98-4504-aaf0-68568709b6d2 of volume b01162e9-1335-4d99-bd25-643b326ce242 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] snapshot_file for this snap is: volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4650d1-9ad7-4db9-a733-b72728d6b44e]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:43 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2 Jul 13 20:50:43 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:43 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a6f183f1-3b29-4e96-b790-f3d5639b4c41 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb 1G" returned: 0 in 0.421s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a6f183f1-3b29-4e96-b790-f3d5639b4c41 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:43 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb Jul 13 20:50:43 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:43 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2" returned: 0 in 0.360s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b01162e9-1335-4d99-bd25-643b326ce242(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:50:43 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ed3a46-8006-4d71-ab7f-4cb749ab1f04]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:43 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a6f183f1-3b29-4e96-b790-f3d5639b4c41 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb" returned: 0 in 0.297s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:43 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-a6f183f1-3b29-4e96-b790-f3d5639b4c41 tempest-ProjectReaderTests-896704004 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb is being set with open permissions: ugo+rw Jul 13 20:50:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a6f183f1-3b29-4e96-b790-f3d5639b4c41 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:43 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb Jul 13 20:50:43 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:43 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 Jul 13 20:50:43 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:43 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a6f183f1-3b29-4e96-b790-f3d5639b4c41 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb" returned: 0 in 0.259s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a6f183f1-3b29-4e96-b790-f3d5639b4c41 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:43 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.info Jul 13 20:50:43 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:43 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242" returned: 0 in 0.386s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:43 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2 Jul 13 20:50:43 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:43 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a6f183f1-3b29-4e96-b790-f3d5639b4c41 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.info" returned: 0 in 0.274s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:43 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-a6f183f1-3b29-4e96-b790-f3d5639b4c41 tempest-ProjectReaderTests-896704004 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.info is being set with open permissions: ugo+rw Jul 13 20:50:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a6f183f1-3b29-4e96-b790-f3d5639b4c41 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:43 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.info Jul 13 20:50:43 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:44 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2" returned: 0 in 0.357s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:44 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2 Jul 13 20:50:44 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:44 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a6f183f1-3b29-4e96-b790-f3d5639b4c41 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.info" returned: 0 in 0.256s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a6f183f1-3b29-4e96-b790-f3d5639b4c41 tempest-ProjectReaderTests-896704004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.472s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-771942382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7efff2-8483-417f-923b-f02ac7a5eb69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c38df1850474d9a82d8fc73b3b0553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:42Z,use_quota=True,user_id='ffe1c94cc7714b9b8648f410124784e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Creating volume 7c7efff2-8483-417f-923b-f02ac7a5eb69 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:50:44 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:44 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69 1073741824 Jul 13 20:50:44 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:44 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a6f183f1-3b29-4e96-b790-f3d5639b4c41 tempest-ProjectReaderTests-896704004 None] Create snapshot completed successfully Jul 13 20:50:44 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242.8108e1da-eb98-4504-aaf0-68568709b6d2" returned: 0 in 0.268s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] Lock "cinder-quobyte-8108e1da-eb98-4504-aaf0-68568709b6d2" released by "_delete_snapshot" :: held 1.464s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] Lock "cinder-quobyte-b01162e9-1335-4d99-bd25-643b326ce242" released by "delete_snapshot" :: held 1.487s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] Created reservations ['3c940259-ea6f-4287-9e18-9eb1f3648e61', '92b03c2f-81b2-43ef-964d-ad371dd19559', '0d146518-c19a-4313-b98c-02eb35908222', '680963e9-da30-4d7c-b233-43a09e3e7b4e'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:44 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] Delete snapshot completed successfully. Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-55baf8de-79fe-4b3b-b117-773177f7919a tempest-SnapshotDependencyTests-160339006 None] Lock "cinder-8108e1da-eb98-4504-aaf0-68568709b6d2-delete_snapshot" released by "delete_snapshot" :: held 1.643s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:44 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69 1073741824" returned: 0 in 0.438s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:44 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69 Jul 13 20:50:44 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:44 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69" returned: 0 in 0.269s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6141305-7f7d-44a6-8778-13f4e9799890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c7efff2-8483-417f-923b-f02ac7a5eb69', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2139648-e2ba-4ce0-a7ad-22296853d4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:45 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Volume volume-7c7efff2-8483-417f-923b-f02ac7a5eb69 (7c7efff2-8483-417f-923b-f02ac7a5eb69): created successfully Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2139648-e2ba-4ce0-a7ad-22296853d4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Flow 'volume_create_manager' (39c2d427-9a3d-40dd-bf79-4e9259001228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] Acquiring lock "cinder-b01162e9-1335-4d99-bd25-643b326ce242-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:45 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b5140119-5e18-408b-9e82-b254a7118047 tempest-ProjectMemberTests-1245199771 None] Created volume successfully. Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] Lock "cinder-b01162e9-1335-4d99-bd25-643b326ce242-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] Acquiring lock "cinder-quobyte-b01162e9-1335-4d99-bd25-643b326ce242" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] Lock "cinder-quobyte-b01162e9-1335-4d99-bd25-643b326ce242" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ba30ae-07a2-43db-a7b3-e94e7873abc5]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:45 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 Jul 13 20:50:45 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-575a8df5-db00-4bf1-ae66-f356fe99c1cb-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] Lock "cinder-575a8df5-db00-4bf1-ae66-f356fe99c1cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-quobyte-3dfec267-fff3-4456-b55d-e3fcf9c2bffa" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-3dfec267-fff3-4456-b55d-e3fcf9c2bffa" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-quobyte-575a8df5-db00-4bf1-ae66-f356fe99c1cb" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-575a8df5-db00-4bf1-ae66-f356fe99c1cb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] Deleting offline snapshot 575a8df5-db00-4bf1-ae66-f356fe99c1cb of volume 3dfec267-fff3-4456-b55d-e3fcf9c2bffa {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] snapshot_file for this snap is: volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5adda4-31e4-4117-855c-897f6238f322]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:45 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242" returned: 0 in 0.382s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:45 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb Jul 13 20:50:45 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:45 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242 Jul 13 20:50:45 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:45 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-b01162e9-1335-4d99-bd25-643b326ce242" returned: 0 in 0.245s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] Lock "cinder-quobyte-b01162e9-1335-4d99-bd25-643b326ce242" released by "delete_volume" :: held 0.686s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:45 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb" returned: 0 in 0.369s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cf0b4f-19a9-400c-804f-c98a92eedeb3]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] Created reservations ['4a3603eb-b7d8-42d0-b8ef-d12add924bc2', '7c78a09a-21af-49f2-b2e4-47804f4eef48', '80d37a4f-4e88-4c4d-a97e-2ffcaf9ec941', '907ac5c4-fdc0-43c8-80ce-c6b33111de9b'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:45 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa Jul 13 20:50:45 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:45 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:50:45 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5a77b6af-5905-4790-9d26-5752c1dda9a4 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5a77b6af-5905-4790-9d26-5752c1dda9a4 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5a77b6af-5905-4790-9d26-5752c1dda9a4 tempest-ProjectMemberTests-1245199771 None] Creating offline snapshot e2a6ef2a-5481-4eec-9941-b2158699fd49 of volume 7c7efff2-8483-417f-923b-f02ac7a5eb69 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bc3c77-7d20-4350-85cb-aca91ac467ac]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a77b6af-5905-4790-9d26-5752c1dda9a4 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] Acquiring lock "cinder-35df9250-5ee4-4078-8677-177073c241c7-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] Lock "cinder-35df9250-5ee4-4078-8677-177073c241c7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:46 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa" returned: 0 in 0.441s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:46 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:46 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69 Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.333s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:46 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:50:46 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] Deleted volume successfully. Jul 13 20:50:46 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb Jul 13 20:50:46 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] Acquiring lock "cinder-quobyte-35df9250-5ee4-4078-8677-177073c241c7" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] Lock "cinder-quobyte-35df9250-5ee4-4078-8677-177073c241c7" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ca47101a-79d7-44b9-b666-53d36aaf42cd tempest-SnapshotDependencyTests-160339006 None] Lock "cinder-b01162e9-1335-4d99-bd25-643b326ce242-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[92028c08-a564-4fe5-983f-cb44150e607a]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-35df9250-5ee4-4078-8677-177073c241c7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:46 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-35df9250-5ee4-4078-8677-177073c241c7 Jul 13 20:50:46 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:46 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a77b6af-5905-4790-9d26-5752c1dda9a4 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69" returned: 0 in 0.464s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a77b6af-5905-4790-9d26-5752c1dda9a4 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:46 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49 1G Jul 13 20:50:46 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:46 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb" returned: 0 in 0.379s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:46 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb Jul 13 20:50:46 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:46 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-35df9250-5ee4-4078-8677-177073c241c7" returned: 0 in 0.376s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-35df9250-5ee4-4078-8677-177073c241c7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:46 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-35df9250-5ee4-4078-8677-177073c241c7 Jul 13 20:50:46 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:46 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa.575a8df5-db00-4bf1-ae66-f356fe99c1cb" returned: 0 in 0.277s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-575a8df5-db00-4bf1-ae66-f356fe99c1cb" released by "_delete_snapshot" :: held 1.572s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-3dfec267-fff3-4456-b55d-e3fcf9c2bffa" released by "delete_snapshot" :: held 1.593s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:47 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-35df9250-5ee4-4078-8677-177073c241c7" returned: 0 in 0.279s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:47 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] Lock "cinder-quobyte-35df9250-5ee4-4078-8677-177073c241c7" released by "delete_volume" :: held 0.706s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a77b6af-5905-4790-9d26-5752c1dda9a4 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49 1G" returned: 0 in 0.448s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a77b6af-5905-4790-9d26-5752c1dda9a4 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c7efff2-8483-417f-923b-f02ac7a5eb69 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] Created reservations ['34a9f115-a5af-4b1d-92d4-67b537461b4a', 'bd885164-6e69-4547-9f75-0af213791ba3', '720f423f-2b64-4d22-acd2-d251ddc77dd8', '70ce4f7b-171e-4b65-8df2-bf290624076d'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:47 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c7efff2-8483-417f-923b-f02ac7a5eb69 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49 Jul 13 20:50:47 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] Created reservations ['e0c08aa5-e122-4953-b0ed-98f9ccc0a4da', '0b95a16e-a90d-4133-9ef7-c53da85d2ebe', '863992bf-b57a-4c4b-bdef-b7b90dda4d71', '642ee743-3c08-4106-8935-c4e56ebd01f8'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] Delete snapshot completed successfully. Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1925764b-a135-4c97-8701-94b0ab0628eb tempest-ProjectReaderTests-896704004 None] Lock "cinder-575a8df5-db00-4bf1-ae66-f356fe99c1cb-delete_snapshot" released by "delete_snapshot" :: held 1.815s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:47 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:50:47 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:47 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a77b6af-5905-4790-9d26-5752c1dda9a4 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c7efff2-8483-417f-923b-f02ac7a5eb69 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49" returned: 0 in 0.366s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:47 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-5a77b6af-5905-4790-9d26-5752c1dda9a4 tempest-ProjectMemberTests-1245199771 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49 is being set with open permissions: ugo+rw Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a77b6af-5905-4790-9d26-5752c1dda9a4 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:47 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49 Jul 13 20:50:47 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-3dfec267-fff3-4456-b55d-e3fcf9c2bffa-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:47 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] Lock "cinder-3dfec267-fff3-4456-b55d-e3fcf9c2bffa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.340s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:50:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] Deleted volume successfully. Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7ad795a2-76e2-4286-b476-93d6de214767 tempest-SnapshotDependencyTests-160339006 None] Lock "cinder-35df9250-5ee4-4078-8677-177073c241c7-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] Acquiring lock "cinder-quobyte-3dfec267-fff3-4456-b55d-e3fcf9c2bffa" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-3dfec267-fff3-4456-b55d-e3fcf9c2bffa" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcecb6e-ed0a-4be0-8d19-b980385fa2ae]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:47 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a77b6af-5905-4790-9d26-5752c1dda9a4 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49" returned: 0 in 0.294s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a77b6af-5905-4790-9d26-5752c1dda9a4 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:47 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.info Jul 13 20:50:47 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:47 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa Jul 13 20:50:47 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:47 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a77b6af-5905-4790-9d26-5752c1dda9a4 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.info" returned: 0 in 0.268s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:48 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-5a77b6af-5905-4790-9d26-5752c1dda9a4 tempest-ProjectMemberTests-1245199771 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.info is being set with open permissions: ugo+rw Jul 13 20:50:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a77b6af-5905-4790-9d26-5752c1dda9a4 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:48 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.info Jul 13 20:50:48 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:48 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa" returned: 0 in 0.376s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:48 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa Jul 13 20:50:48 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:48 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a77b6af-5905-4790-9d26-5752c1dda9a4 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.info" returned: 0 in 0.293s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5a77b6af-5905-4790-9d26-5752c1dda9a4 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:48 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-3dfec267-fff3-4456-b55d-e3fcf9c2bffa" returned: 0 in 0.299s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] Lock "cinder-quobyte-3dfec267-fff3-4456-b55d-e3fcf9c2bffa" released by "delete_volume" :: held 0.742s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:48 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5a77b6af-5905-4790-9d26-5752c1dda9a4 tempest-ProjectMemberTests-1245199771 None] Create snapshot completed successfully Jul 13 20:50:48 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] Created reservations ['21a70811-3053-4797-911b-5d7f0d80f19e', '6a358414-913b-4616-a31e-68534035b65f', '65d6244d-c710-4516-8fcf-bde9dded32fc', '0ce06b42-a4c6-4d64-ae2a-309b374ca5af'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:48 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:50:48 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:48 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.268s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:48 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:50:48 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] Deleted volume successfully. Jul 13 20:50:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9653946f-c662-4768-abb2-f688844d6c92 tempest-ProjectReaderTests-896704004 None] Lock "cinder-3dfec267-fff3-4456-b55d-e3fcf9c2bffa-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-e2a6ef2a-5481-4eec-9941-b2158699fd49-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-e2a6ef2a-5481-4eec-9941-b2158699fd49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-7c7efff2-8483-417f-923b-f02ac7a5eb69" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-7c7efff2-8483-417f-923b-f02ac7a5eb69" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-e2a6ef2a-5481-4eec-9941-b2158699fd49" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-e2a6ef2a-5481-4eec-9941-b2158699fd49" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] Deleting offline snapshot e2a6ef2a-5481-4eec-9941-b2158699fd49 of volume 7c7efff2-8483-417f-923b-f02ac7a5eb69 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:50:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] snapshot_file for this snap is: volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:50:49 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[504051a8-fc8d-4b04-a03e-44c898e950a2]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:49 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49 Jul 13 20:50:49 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:49 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49" returned: 0 in 0.463s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c7efff2-8483-417f-923b-f02ac7a5eb69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:50:49 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe73ed37-fbc2-405f-aa57-544c783c1b70]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:49 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69 Jul 13 20:50:49 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:50 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69" returned: 0 in 0.427s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:50 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49 Jul 13 20:50:50 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:50 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49" returned: 0 in 0.512s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:50 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49 Jul 13 20:50:50 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:51 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69.e2a6ef2a-5481-4eec-9941-b2158699fd49" returned: 0 in 0.268s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-e2a6ef2a-5481-4eec-9941-b2158699fd49" released by "_delete_snapshot" :: held 1.794s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-7c7efff2-8483-417f-923b-f02ac7a5eb69" released by "delete_snapshot" :: held 1.818s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:51 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] Created reservations ['df02a7c8-6fd3-4aeb-af53-754f421c933e', '7d4c14e4-de31-46f3-a954-dbab05eccf7c', '658ebb78-5e33-4031-b711-97a52b0db18b', '165c224d-0b81-4212-a0b9-719230b222de'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:51 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] Delete snapshot completed successfully. Jul 13 20:50:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-32a1b2c5-23dc-4d94-958e-c7b790acdad6 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-e2a6ef2a-5481-4eec-9941-b2158699fd49-delete_snapshot" released by "delete_snapshot" :: held 2.015s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-7c7efff2-8483-417f-923b-f02ac7a5eb69-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-7c7efff2-8483-417f-923b-f02ac7a5eb69-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-7c7efff2-8483-417f-923b-f02ac7a5eb69" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-7c7efff2-8483-417f-923b-f02ac7a5eb69" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:51 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab3b9a4-27d9-450f-a48b-fa7c23a391a0]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:51 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69 Jul 13 20:50:51 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:52 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69" returned: 0 in 0.398s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:52 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69 Jul 13 20:50:52 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:52 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-7c7efff2-8483-417f-923b-f02ac7a5eb69" returned: 0 in 0.319s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-7c7efff2-8483-417f-923b-f02ac7a5eb69" released by "delete_volume" :: held 0.812s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:52 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] Created reservations ['40d8ab2f-2934-41a5-a68d-2049a36149fc', '770f3cde-1aa4-494b-aade-79f5f6ce3c90', '6b5c0484-2fb9-4b58-ad13-e38ce763547f', 'b02b46b4-2d5c-46c0-a829-9d270dc4c21a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:52 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:50:52 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:52 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.328s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:52 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:50:52 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] Deleted volume successfully. Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-31ef9b7f-3925-489d-8351-5dbe00299669 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-7c7efff2-8483-417f-923b-f02ac7a5eb69-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Flow 'volume_create_manager' (eeba53cf-09e1-4d35-bdc3-a28cc467445f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4064f5-331b-4619-b75c-f6a00f72c44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4064f5-331b-4619-b75c-f6a00f72c44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1671606669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff82b5e3-db83-464e-ab4f-1b6b370903b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c38df1850474d9a82d8fc73b3b0553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:54Z,use_quota=True,user_id='ffe1c94cc7714b9b8648f410124784e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421f8db4-d309-4bed-95a9-79da80eefcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421f8db4-d309-4bed-95a9-79da80eefcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d17e1a2-df9c-48d1-b8ee-7cf28ac3809d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d17e1a2-df9c-48d1-b8ee-7cf28ac3809d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff82b5e3-db83-464e-ab4f-1b6b370903b8', 'volume_name': 'volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc6f3ce-9a72-488f-a780-f68adc0e9b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc6f3ce-9a72-488f-a780-f68adc0e9b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50faf935-9a6f-42cb-8520-b38b18f5dc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:53 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Volume ff82b5e3-db83-464e-ab4f-1b6b370903b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8', 'volume_size': 1} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1671606669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff82b5e3-db83-464e-ab4f-1b6b370903b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c38df1850474d9a82d8fc73b3b0553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:54Z,use_quota=True,user_id='ffe1c94cc7714b9b8648f410124784e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Creating volume ff82b5e3-db83-464e-ab4f-1b6b370903b8 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:50:53 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:53 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8 1073741824 Jul 13 20:50:53 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Flow 'volume_create_manager' (b2af69af-a3cd-4c73-a30d-f32e6fd6c773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a214c7c4-33c2-4d8a-8223-3bb469a05608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a214c7c4-33c2-4d8a-8223-3bb469a05608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-606849937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df08c8b0-f63e-47e3-b229-fc3f7011c2d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d768ff69bb44e889d77c773fadfdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:54Z,use_quota=True,user_id='222b3a6f859f4568b5c92d50f660d71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a565a49-a21b-487b-8d81-efd946184eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a565a49-a21b-487b-8d81-efd946184eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0816e33c-639d-49ba-8942-0ca9bf18cd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0816e33c-639d-49ba-8942-0ca9bf18cd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df08c8b0-f63e-47e3-b229-fc3f7011c2d8', 'volume_name': 'volume-df08c8b0-f63e-47e3-b229-fc3f7011c2d8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (437145e8-a362-48aa-8ac0-ff4d4dc8848f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (437145e8-a362-48aa-8ac0-ff4d4dc8848f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f008108b-1343-479b-8ea9-e83be4f95f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:53 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Volume df08c8b0-f63e-47e3-b229-fc3f7011c2d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df08c8b0-f63e-47e3-b229-fc3f7011c2d8', 'volume_size': 1} Jul 13 20:50:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:54 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8 1073741824" returned: 0 in 0.448s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:54 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8 Jul 13 20:50:54 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:54 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8" returned: 0 in 0.274s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:50:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.601s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-606849937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df08c8b0-f63e-47e3-b229-fc3f7011c2d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d768ff69bb44e889d77c773fadfdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:54Z,use_quota=True,user_id='222b3a6f859f4568b5c92d50f660d71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:50:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Creating volume df08c8b0-f63e-47e3-b229-fc3f7011c2d8 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:50:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:50:54 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:50:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-df08c8b0-f63e-47e3-b229-fc3f7011c2d8 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:54 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-df08c8b0-f63e-47e3-b229-fc3f7011c2d8 1073741824 Jul 13 20:50:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50faf935-9a6f-42cb-8520-b38b18f5dc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:54 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ac72c2-790d-4d15-968b-883f2d99ffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:54 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Volume volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8 (ff82b5e3-db83-464e-ab4f-1b6b370903b8): created successfully Jul 13 20:50:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ac72c2-790d-4d15-968b-883f2d99ffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Flow 'volume_create_manager' (eeba53cf-09e1-4d35-bdc3-a28cc467445f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-cd8ddc74-3e8b-463f-900f-d0e38b919405 tempest-ProjectMemberTests-1245199771 None] Created volume successfully. Jul 13 20:50:55 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-df08c8b0-f63e-47e3-b229-fc3f7011c2d8 1073741824" returned: 0 in 0.523s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-df08c8b0-f63e-47e3-b229-fc3f7011c2d8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:55 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-df08c8b0-f63e-47e3-b229-fc3f7011c2d8 Jul 13 20:50:55 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:55 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-df08c8b0-f63e-47e3-b229-fc3f7011c2d8" returned: 0 in 0.257s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:50:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f008108b-1343-479b-8ea9-e83be4f95f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df08c8b0-f63e-47e3-b229-fc3f7011c2d8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13fd505-9cac-483f-8fd2-551f84e8915d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:55 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Volume volume-df08c8b0-f63e-47e3-b229-fc3f7011c2d8 (df08c8b0-f63e-47e3-b229-fc3f7011c2d8): created successfully Jul 13 20:50:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13fd505-9cac-483f-8fd2-551f84e8915d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Flow 'volume_create_manager' (b2af69af-a3cd-4c73-a30d-f32e6fd6c773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b79d604b-b301-42d6-8811-f6dbbf641be5 tempest-ProjectReaderTests-694792309 None] Created volume successfully. Jul 13 20:50:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cd4ecf4b-ade2-475b-8ba4-66a90fdb0cd7 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cd4ecf4b-ade2-475b-8ba4-66a90fdb0cd7 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-cd4ecf4b-ade2-475b-8ba4-66a90fdb0cd7 tempest-ProjectMemberTests-1245199771 None] Creating offline snapshot e8a0537d-af3e-4df9-90b2-034685acca33 of volume ff82b5e3-db83-464e-ab4f-1b6b370903b8 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:50:55 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d5e8cc-175d-46ae-9aa2-72960c3793c8]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd4ecf4b-ade2-475b-8ba4-66a90fdb0cd7 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:55 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8 Jul 13 20:50:55 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] Acquiring lock "cinder-df08c8b0-f63e-47e3-b229-fc3f7011c2d8-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] Lock "cinder-df08c8b0-f63e-47e3-b229-fc3f7011c2d8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] Acquiring lock "cinder-quobyte-df08c8b0-f63e-47e3-b229-fc3f7011c2d8" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] Lock "cinder-quobyte-df08c8b0-f63e-47e3-b229-fc3f7011c2d8" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:56 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[641ba2a8-dc46-4840-ae3a-2fd40363a517]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-df08c8b0-f63e-47e3-b229-fc3f7011c2d8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:56 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd4ecf4b-ade2-475b-8ba4-66a90fdb0cd7 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8" returned: 0 in 0.419s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd4ecf4b-ade2-475b-8ba4-66a90fdb0cd7 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:56 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33 1G Jul 13 20:50:56 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:56 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-df08c8b0-f63e-47e3-b229-fc3f7011c2d8 Jul 13 20:50:56 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:56 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-df08c8b0-f63e-47e3-b229-fc3f7011c2d8" returned: 0 in 0.440s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-df08c8b0-f63e-47e3-b229-fc3f7011c2d8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:56 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-df08c8b0-f63e-47e3-b229-fc3f7011c2d8 Jul 13 20:50:56 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:56 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd4ecf4b-ade2-475b-8ba4-66a90fdb0cd7 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33 1G" returned: 0 in 0.506s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd4ecf4b-ade2-475b-8ba4-66a90fdb0cd7 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:56 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33 Jul 13 20:50:56 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:56 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-df08c8b0-f63e-47e3-b229-fc3f7011c2d8" returned: 0 in 0.288s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] Lock "cinder-quobyte-df08c8b0-f63e-47e3-b229-fc3f7011c2d8" released by "delete_volume" :: held 0.794s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:56 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] Created reservations ['35c9d56f-5cce-40b7-a9b4-4642bad8929f', '270d6704-a3bf-494b-8ef4-3e0c05e04dad', '0fcbea92-d10f-484b-aac6-340bc74dae50', '2a8a5a02-0444-41d0-91de-24f4302b0c79'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:57 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:50:57 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:57 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd4ecf4b-ade2-475b-8ba4-66a90fdb0cd7 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33" returned: 0 in 0.337s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:57 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-cd4ecf4b-ade2-475b-8ba4-66a90fdb0cd7 tempest-ProjectMemberTests-1245199771 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33 is being set with open permissions: ugo+rw Jul 13 20:50:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd4ecf4b-ade2-475b-8ba4-66a90fdb0cd7 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:57 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33 Jul 13 20:50:57 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:57 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.255s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:57 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:50:57 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] Deleted volume successfully. Jul 13 20:50:57 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=174,cinder:UPDATE=219,cinder:INSERT=68,cinder:DELETE=21 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:50:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372910f2-3f3b-4ae6-8fa1-98ef7445e4fa tempest-ProjectReaderTests-694792309 None] Lock "cinder-df08c8b0-f63e-47e3-b229-fc3f7011c2d8-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:57 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd4ecf4b-ade2-475b-8ba4-66a90fdb0cd7 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33" returned: 0 in 0.284s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd4ecf4b-ade2-475b-8ba4-66a90fdb0cd7 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:57 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.info Jul 13 20:50:57 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:57 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd4ecf4b-ade2-475b-8ba4-66a90fdb0cd7 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.info" returned: 0 in 0.279s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:57 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-cd4ecf4b-ade2-475b-8ba4-66a90fdb0cd7 tempest-ProjectMemberTests-1245199771 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.info is being set with open permissions: ugo+rw Jul 13 20:50:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd4ecf4b-ade2-475b-8ba4-66a90fdb0cd7 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:57 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.info Jul 13 20:50:57 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:57 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cd4ecf4b-ade2-475b-8ba4-66a90fdb0cd7 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.info" returned: 0 in 0.281s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cd4ecf4b-ade2-475b-8ba4-66a90fdb0cd7 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.198s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:58 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-cd4ecf4b-ade2-475b-8ba4-66a90fdb0cd7 tempest-ProjectMemberTests-1245199771 None] Create snapshot completed successfully Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Flow 'volume_create_manager' (bae34527-700f-40d5-bfa2-42eb03477b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d2f2ae-7ca7-4cc3-a426-619aef5ba5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:INSERT=58,cinder:UPDATE=242,cinder:SELECT=179,cinder:DELETE=20 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d2f2ae-7ca7-4cc3-a426-619aef5ba5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1864473037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef5addb-0556-46fa-b852-0aca27c415cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d768ff69bb44e889d77c773fadfdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:58Z,use_quota=True,user_id='222b3a6f859f4568b5c92d50f660d71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e59a9a-72e4-4632-9c4c-5f8b86ca5a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e59a9a-72e4-4632-9c4c-5f8b86ca5a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03375947-b821-47c6-ab4b-b4e793e77657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03375947-b821-47c6-ab4b-b4e793e77657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ef5addb-0556-46fa-b852-0aca27c415cc', 'volume_name': 'volume-4ef5addb-0556-46fa-b852-0aca27c415cc', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978a9db3-3098-4159-95e2-5fec10f2d10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978a9db3-3098-4159-95e2-5fec10f2d10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3707482-5e64-48a8-8ac4-bcb721952961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:58 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Volume 4ef5addb-0556-46fa-b852-0aca27c415cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ef5addb-0556-46fa-b852-0aca27c415cc', 'volume_size': 1} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1864473037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef5addb-0556-46fa-b852-0aca27c415cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d768ff69bb44e889d77c773fadfdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:50:58Z,use_quota=True,user_id='222b3a6f859f4568b5c92d50f660d71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Creating volume 4ef5addb-0556-46fa-b852-0aca27c415cc {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:50:58 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4ef5addb-0556-46fa-b852-0aca27c415cc 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:58 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4ef5addb-0556-46fa-b852-0aca27c415cc 1073741824 Jul 13 20:50:58 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:58 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4ef5addb-0556-46fa-b852-0aca27c415cc 1073741824" returned: 0 in 0.428s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4ef5addb-0556-46fa-b852-0aca27c415cc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:58 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4ef5addb-0556-46fa-b852-0aca27c415cc Jul 13 20:50:58 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:58 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4ef5addb-0556-46fa-b852-0aca27c415cc" returned: 0 in 0.235s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3707482-5e64-48a8-8ac4-bcb721952961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ef5addb-0556-46fa-b852-0aca27c415cc', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3160dc8f-79a1-4e71-80b2-01ebb769ba4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:50:58 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Volume volume-4ef5addb-0556-46fa-b852-0aca27c415cc (4ef5addb-0556-46fa-b852-0aca27c415cc): created successfully Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3160dc8f-79a1-4e71-80b2-01ebb769ba4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Flow 'volume_create_manager' (bae34527-700f-40d5-bfa2-42eb03477b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:50:58 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9551fcd9-0143-4462-826f-d80ca28ae7a3 tempest-ProjectReaderTests-694792309 None] Created volume successfully. Jul 13 20:50:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-e8a0537d-af3e-4df9-90b2-034685acca33-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-e8a0537d-af3e-4df9-90b2-034685acca33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-ff82b5e3-db83-464e-ab4f-1b6b370903b8" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-ff82b5e3-db83-464e-ab4f-1b6b370903b8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-e8a0537d-af3e-4df9-90b2-034685acca33" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-e8a0537d-af3e-4df9-90b2-034685acca33" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] Deleting offline snapshot e8a0537d-af3e-4df9-90b2-034685acca33 of volume ff82b5e3-db83-464e-ab4f-1b6b370903b8 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] snapshot_file for this snap is: volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe141d6a-7ae4-40d7-89a8-45f879832e80]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] Acquiring lock "cinder-4ef5addb-0556-46fa-b852-0aca27c415cc-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] Lock "cinder-4ef5addb-0556-46fa-b852-0aca27c415cc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] Acquiring lock "cinder-quobyte-4ef5addb-0556-46fa-b852-0aca27c415cc" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] Lock "cinder-quobyte-4ef5addb-0556-46fa-b852-0aca27c415cc" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:50:59 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33 Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38fcb46-73a3-4779-9ca4-11bef14ca1aa]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:59 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4ef5addb-0556-46fa-b852-0aca27c415cc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:59 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4ef5addb-0556-46fa-b852-0aca27c415cc Jul 13 20:50:59 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:59 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33" returned: 0 in 0.383s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd4739c-695c-48f4-aca3-125c311d99c3]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:59 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4ef5addb-0556-46fa-b852-0aca27c415cc" returned: 0 in 0.358s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4ef5addb-0556-46fa-b852-0aca27c415cc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:59 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8 Jul 13 20:50:59 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:59 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4ef5addb-0556-46fa-b852-0aca27c415cc Jul 13 20:50:59 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:59 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-4ef5addb-0556-46fa-b852-0aca27c415cc" returned: 0 in 0.242s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] Lock "cinder-quobyte-4ef5addb-0556-46fa-b852-0aca27c415cc" released by "delete_volume" :: held 0.637s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:50:59 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8" returned: 0 in 0.362s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:59 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33 Jul 13 20:50:59 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] Created reservations ['423b3120-6fec-4599-b7b8-9651593d5391', 'fb24486f-da72-4a2b-99e2-1eae7dd11103', '9580b46c-1987-40a9-88db-a51a0fc1b313', '9ade1a81-8ad3-4926-95f5-4a274807eca9'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:50:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:50:59 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:50:59 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:00 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33" returned: 0 in 0.360s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:00 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33 Jul 13 20:51:00 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:00 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.273s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:00 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:51:00 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] Deleted volume successfully. Jul 13 20:51:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-507aa232-6459-4b66-9e4a-0e741fcf3fc5 tempest-ProjectReaderTests-694792309 None] Lock "cinder-4ef5addb-0556-46fa-b852-0aca27c415cc-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:00 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8.e8a0537d-af3e-4df9-90b2-034685acca33" returned: 0 in 0.266s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-e8a0537d-af3e-4df9-90b2-034685acca33" released by "_delete_snapshot" :: held 1.459s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-ff82b5e3-db83-464e-ab4f-1b6b370903b8" released by "delete_snapshot" :: held 1.482s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:00 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] Created reservations ['ead28fe0-0823-44c8-aa64-f6a9fc5d9195', '869f3286-7fce-4c6d-b024-e320a79ae35b', '1068a0b4-b8f9-401e-9f93-972adb65f1f1', '34f2f20d-f87f-4c51-be0c-8ba62cedc130'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:51:00 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] Delete snapshot completed successfully. Jul 13 20:51:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-54d3cc04-83b9-430c-9b8d-2959b818f375 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-e8a0537d-af3e-4df9-90b2-034685acca33-delete_snapshot" released by "delete_snapshot" :: held 1.613s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-ff82b5e3-db83-464e-ab4f-1b6b370903b8-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] Lock "cinder-ff82b5e3-db83-464e-ab4f-1b6b370903b8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-ff82b5e3-db83-464e-ab4f-1b6b370903b8" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-ff82b5e3-db83-464e-ab4f-1b6b370903b8" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:01 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c7b0d4-2f55-492a-9593-f4d5f260c6ba]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:01 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8 Jul 13 20:51:01 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:01 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8" returned: 0 in 0.382s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:01 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8 Jul 13 20:51:01 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:01 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-ff82b5e3-db83-464e-ab4f-1b6b370903b8" returned: 0 in 0.257s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-ff82b5e3-db83-464e-ab4f-1b6b370903b8" released by "delete_volume" :: held 0.700s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] Created reservations ['92200a41-e4d1-4ab7-9a25-9f80d3e8ff09', 'c8734e1a-81bf-4ec9-8c71-2e6ea6a227ce', '06f54d97-b2dc-49c5-ad6d-27ef2ed15f6a', '52492039-03ca-41cf-8708-4946ae4e942e'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:02 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:51:02 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:02 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.282s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:51:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] Deleted volume successfully. Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-48c2eb70-9f24-4b33-baa2-495e4549d9ca tempest-ProjectMemberTests-1245199771 None] Lock "cinder-ff82b5e3-db83-464e-ab4f-1b6b370903b8-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Flow 'volume_create_manager' (17d4f521-2c6b-40b1-ab0b-9eabfc53f9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d346c2c-3c08-4245-9014-0fccd1a37067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d346c2c-3c08-4245-9014-0fccd1a37067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1837084844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336a65b4-fdd5-4338-a635-b954c15e290f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c38df1850474d9a82d8fc73b3b0553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:51:03Z,use_quota=True,user_id='ffe1c94cc7714b9b8648f410124784e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084fcccb-b6bc-4404-949f-52aee31e1621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084fcccb-b6bc-4404-949f-52aee31e1621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe93ef96-d01e-4e54-891b-cfc934f9eb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe93ef96-d01e-4e54-891b-cfc934f9eb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '336a65b4-fdd5-4338-a635-b954c15e290f', 'volume_name': 'volume-336a65b4-fdd5-4338-a635-b954c15e290f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3ec464-c59c-4626-b2ff-0fd198aac0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3ec464-c59c-4626-b2ff-0fd198aac0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ffbf26-4c40-4873-8f9e-dc3e31fd3ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:02 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Volume 336a65b4-fdd5-4338-a635-b954c15e290f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-336a65b4-fdd5-4338-a635-b954c15e290f', 'volume_size': 1} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1837084844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336a65b4-fdd5-4338-a635-b954c15e290f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c38df1850474d9a82d8fc73b3b0553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:51:03Z,use_quota=True,user_id='ffe1c94cc7714b9b8648f410124784e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Creating volume 336a65b4-fdd5-4338-a635-b954c15e290f {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:51:02 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:51:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:03 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f 1073741824 Jul 13 20:51:03 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:03 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f 1073741824" returned: 0 in 0.472s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:03 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f Jul 13 20:51:03 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:03 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f" returned: 0 in 0.249s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:51:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ffbf26-4c40-4873-8f9e-dc3e31fd3ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-336a65b4-fdd5-4338-a635-b954c15e290f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d681ee-8b59-492d-838c-a7ab58a5e9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:03 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Volume volume-336a65b4-fdd5-4338-a635-b954c15e290f (336a65b4-fdd5-4338-a635-b954c15e290f): created successfully Jul 13 20:51:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d681ee-8b59-492d-838c-a7ab58a5e9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Flow 'volume_create_manager' (17d4f521-2c6b-40b1-ab0b-9eabfc53f9d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:51:03 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-dfcfe851-3638-41a9-9b25-b159c6e6697e tempest-ProjectMemberTests-1245199771 None] Created volume successfully. Jul 13 20:51:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-785c9291-d96c-4a0f-bd61-178c92c1c7a9 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-785c9291-d96c-4a0f-bd61-178c92c1c7a9 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-785c9291-d96c-4a0f-bd61-178c92c1c7a9 tempest-ProjectMemberTests-1245199771 None] Creating offline snapshot f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e of volume 336a65b4-fdd5-4338-a635-b954c15e290f {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:51:04 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dddefb-ef5c-4e4c-a327-041b99897887]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-785c9291-d96c-4a0f-bd61-178c92c1c7a9 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:04 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f Jul 13 20:51:04 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:04 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-785c9291-d96c-4a0f-bd61-178c92c1c7a9 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f" returned: 0 in 0.384s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-785c9291-d96c-4a0f-bd61-178c92c1c7a9 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:04 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e 1G Jul 13 20:51:04 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:04 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-785c9291-d96c-4a0f-bd61-178c92c1c7a9 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e 1G" returned: 0 in 0.430s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-785c9291-d96c-4a0f-bd61-178c92c1c7a9 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-336a65b4-fdd5-4338-a635-b954c15e290f -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:04 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-336a65b4-fdd5-4338-a635-b954c15e290f -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e Jul 13 20:51:04 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:05 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-785c9291-d96c-4a0f-bd61-178c92c1c7a9 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-336a65b4-fdd5-4338-a635-b954c15e290f -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e" returned: 0 in 0.306s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:05 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-785c9291-d96c-4a0f-bd61-178c92c1c7a9 tempest-ProjectMemberTests-1245199771 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e is being set with open permissions: ugo+rw Jul 13 20:51:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-785c9291-d96c-4a0f-bd61-178c92c1c7a9 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:05 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e Jul 13 20:51:05 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:05 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-785c9291-d96c-4a0f-bd61-178c92c1c7a9 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e" returned: 0 in 0.259s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-785c9291-d96c-4a0f-bd61-178c92c1c7a9 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:05 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.info Jul 13 20:51:05 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:05 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-785c9291-d96c-4a0f-bd61-178c92c1c7a9 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.info" returned: 0 in 0.266s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:05 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-785c9291-d96c-4a0f-bd61-178c92c1c7a9 tempest-ProjectMemberTests-1245199771 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.info is being set with open permissions: ugo+rw Jul 13 20:51:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-785c9291-d96c-4a0f-bd61-178c92c1c7a9 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:05 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.info Jul 13 20:51:05 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:06 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-785c9291-d96c-4a0f-bd61-178c92c1c7a9 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.info" returned: 0 in 0.283s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-785c9291-d96c-4a0f-bd61-178c92c1c7a9 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.033s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-785c9291-d96c-4a0f-bd61-178c92c1c7a9 tempest-ProjectMemberTests-1245199771 None] Create snapshot completed successfully Jul 13 20:51:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] Lock "cinder-f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-336a65b4-fdd5-4338-a635-b954c15e290f" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-336a65b4-fdd5-4338-a635-b954c15e290f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] Deleting offline snapshot f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e of volume 336a65b4-fdd5-4338-a635-b954c15e290f {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:51:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] snapshot_file for this snap is: volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:51:07 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a8e011-eda0-4df9-85d8-736f8312abec]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:07 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e Jul 13 20:51:07 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:07 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e" returned: 0 in 0.348s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-336a65b4-fdd5-4338-a635-b954c15e290f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:51:07 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e42ffc8-e73a-44f2-bdfe-d24578b5d727]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:07 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f Jul 13 20:51:07 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:08 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f" returned: 0 in 0.350s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:08 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e Jul 13 20:51:08 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:08 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e" returned: 0 in 0.332s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:08 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e Jul 13 20:51:08 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:08 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f.f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e" returned: 0 in 0.243s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e" released by "_delete_snapshot" :: held 1.360s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-336a65b4-fdd5-4338-a635-b954c15e290f" released by "delete_snapshot" :: held 1.381s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:08 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] Created reservations ['c163c66a-481e-480f-ab9e-e389011474b4', '50a46c8e-bf33-4154-9a78-e197b858b7d5', '31eada22-418f-47dd-9324-c71b57f24113', '753046a2-43ce-4742-82ce-aea0228bfad3'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:51:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] Delete snapshot completed successfully. Jul 13 20:51:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef7d6025-0d94-41fc-9c85-d50ce87de78b tempest-ProjectMemberTests-1245199771 None] Lock "cinder-f0f8b685-8e6b-4d84-bc3e-12e7b82ff05e-delete_snapshot" released by "delete_snapshot" :: held 1.512s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-336a65b4-fdd5-4338-a635-b954c15e290f-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-336a65b4-fdd5-4338-a635-b954c15e290f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-336a65b4-fdd5-4338-a635-b954c15e290f" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-336a65b4-fdd5-4338-a635-b954c15e290f" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:09 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b8418b-53e2-4a48-9ae4-cee4afe06a0c]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:09 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f Jul 13 20:51:09 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:09 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f" returned: 0 in 0.361s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:09 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f Jul 13 20:51:09 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:10 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-336a65b4-fdd5-4338-a635-b954c15e290f" returned: 0 in 0.239s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-336a65b4-fdd5-4338-a635-b954c15e290f" released by "delete_volume" :: held 0.657s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:10 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] Created reservations ['a0fd1e0a-dcd6-49ff-930f-564577a8ea87', 'a7983287-c200-43fd-8cf3-23e0b3e27177', '86de93a0-2065-4d5e-b14d-b63ac613dc34', 'f93f587a-0d82-4343-8aa0-1bde61db318e'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:51:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:51:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:51:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:10 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:51:10 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:10 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.253s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:10 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:51:10 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] Deleted volume successfully. Jul 13 20:51:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bee79da0-fb5e-4646-8d06-eb8784ea9f38 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-336a65b4-fdd5-4338-a635-b954c15e290f-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:10 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Flow 'volume_create_manager' (f064c569-e6a7-4947-b3ab-2cbc09fae920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9cf7497-f5cb-495b-8026-b8d9dec789d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9cf7497-f5cb-495b-8026-b8d9dec789d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1313650434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca78905-f899-4088-9de8-e7b227bc0767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c38df1850474d9a82d8fc73b3b0553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:51:11Z,use_quota=True,user_id='ffe1c94cc7714b9b8648f410124784e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10743a10-2100-444e-b99a-c8cb39562fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10743a10-2100-444e-b99a-c8cb39562fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bced4a35-36b4-4529-89b4-0f6c655793be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bced4a35-36b4-4529-89b4-0f6c655793be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ca78905-f899-4088-9de8-e7b227bc0767', 'volume_name': 'volume-0ca78905-f899-4088-9de8-e7b227bc0767', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0bd6ef-9888-4c8b-a59b-7682c5c935cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0bd6ef-9888-4c8b-a59b-7682c5c935cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66f4b12-99e0-4445-a9e9-aec15a4ad91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:11 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Volume 0ca78905-f899-4088-9de8-e7b227bc0767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ca78905-f899-4088-9de8-e7b227bc0767', 'volume_size': 1} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1313650434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca78905-f899-4088-9de8-e7b227bc0767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c38df1850474d9a82d8fc73b3b0553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:51:11Z,use_quota=True,user_id='ffe1c94cc7714b9b8648f410124784e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Creating volume 0ca78905-f899-4088-9de8-e7b227bc0767 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:51:11 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:11 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767 1073741824 Jul 13 20:51:11 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:11 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767 1073741824" returned: 0 in 0.406s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:11 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767 Jul 13 20:51:11 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:11 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767" returned: 0 in 0.234s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66f4b12-99e0-4445-a9e9-aec15a4ad91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ca78905-f899-4088-9de8-e7b227bc0767', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c929292-2578-416a-a37a-ec4ffae1d651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:11 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Volume volume-0ca78905-f899-4088-9de8-e7b227bc0767 (0ca78905-f899-4088-9de8-e7b227bc0767): created successfully Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c929292-2578-416a-a37a-ec4ffae1d651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Flow 'volume_create_manager' (f064c569-e6a7-4947-b3ab-2cbc09fae920) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:51:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-564b326d-cafd-410e-a995-913ffc0daee4 tempest-ProjectMemberTests-1245199771 None] Created volume successfully. Jul 13 20:51:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3557ec9e-5096-495d-ba70-5bfc15b06b2f tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3557ec9e-5096-495d-ba70-5bfc15b06b2f tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3557ec9e-5096-495d-ba70-5bfc15b06b2f tempest-ProjectMemberTests-1245199771 None] Creating offline snapshot ae7ff891-9b9b-49ad-8aee-07435cb41e6c of volume 0ca78905-f899-4088-9de8-e7b227bc0767 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:51:12 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6332d94-076a-49c0-b247-15d98d5d7273]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3557ec9e-5096-495d-ba70-5bfc15b06b2f tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:12 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767 Jul 13 20:51:12 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:12 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3557ec9e-5096-495d-ba70-5bfc15b06b2f tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767" returned: 0 in 0.354s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3557ec9e-5096-495d-ba70-5bfc15b06b2f tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:12 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c 1G Jul 13 20:51:12 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:12 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3557ec9e-5096-495d-ba70-5bfc15b06b2f tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c 1G" returned: 0 in 0.388s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3557ec9e-5096-495d-ba70-5bfc15b06b2f tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ca78905-f899-4088-9de8-e7b227bc0767 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:12 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ca78905-f899-4088-9de8-e7b227bc0767 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c Jul 13 20:51:12 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:13 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3557ec9e-5096-495d-ba70-5bfc15b06b2f tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ca78905-f899-4088-9de8-e7b227bc0767 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c" returned: 0 in 0.304s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:13 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-3557ec9e-5096-495d-ba70-5bfc15b06b2f tempest-ProjectMemberTests-1245199771 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c is being set with open permissions: ugo+rw Jul 13 20:51:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3557ec9e-5096-495d-ba70-5bfc15b06b2f tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:13 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c Jul 13 20:51:13 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:13 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3557ec9e-5096-495d-ba70-5bfc15b06b2f tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c" returned: 0 in 0.261s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3557ec9e-5096-495d-ba70-5bfc15b06b2f tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:13 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.info Jul 13 20:51:13 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:13 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3557ec9e-5096-495d-ba70-5bfc15b06b2f tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.info" returned: 0 in 0.243s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:13 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-3557ec9e-5096-495d-ba70-5bfc15b06b2f tempest-ProjectMemberTests-1245199771 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.info is being set with open permissions: ugo+rw Jul 13 20:51:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3557ec9e-5096-495d-ba70-5bfc15b06b2f tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:13 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.info Jul 13 20:51:13 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:13 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3557ec9e-5096-495d-ba70-5bfc15b06b2f tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.info" returned: 0 in 0.242s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3557ec9e-5096-495d-ba70-5bfc15b06b2f tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.865s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3557ec9e-5096-495d-ba70-5bfc15b06b2f tempest-ProjectMemberTests-1245199771 None] Create snapshot completed successfully Jul 13 20:51:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-ae7ff891-9b9b-49ad-8aee-07435cb41e6c-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-ae7ff891-9b9b-49ad-8aee-07435cb41e6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-0ca78905-f899-4088-9de8-e7b227bc0767" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-0ca78905-f899-4088-9de8-e7b227bc0767" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-ae7ff891-9b9b-49ad-8aee-07435cb41e6c" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-ae7ff891-9b9b-49ad-8aee-07435cb41e6c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] Deleting offline snapshot ae7ff891-9b9b-49ad-8aee-07435cb41e6c of volume 0ca78905-f899-4088-9de8-e7b227bc0767 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:51:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] snapshot_file for this snap is: volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:51:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd775f7-d1ad-4db7-95f1-3dc29a7d1f1d]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:14 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c Jul 13 20:51:14 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:14 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c" returned: 0 in 0.347s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ca78905-f899-4088-9de8-e7b227bc0767(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:51:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3b0080-610d-4c3b-8a38-1725ca76bc7d]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:14 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767 Jul 13 20:51:14 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:15 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767" returned: 0 in 0.337s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:15 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c Jul 13 20:51:15 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:15 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c" returned: 0 in 0.344s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:15 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c Jul 13 20:51:15 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:15 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767.ae7ff891-9b9b-49ad-8aee-07435cb41e6c" returned: 0 in 0.246s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-ae7ff891-9b9b-49ad-8aee-07435cb41e6c" released by "_delete_snapshot" :: held 1.362s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-0ca78905-f899-4088-9de8-e7b227bc0767" released by "delete_snapshot" :: held 1.384s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:15 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] Created reservations ['3eb13746-a7de-42cd-b7c6-630c7716f9a9', '14a178bf-99e8-4c6d-a688-a2a6d9615b90', 'f0f4530e-e51c-4b5c-a052-ed53eded5b43', '62a938e9-146a-4eb4-be55-149df8013df3'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:51:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] Delete snapshot completed successfully. Jul 13 20:51:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e8d942c6-a1af-4559-b90a-01333ff7b553 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-ae7ff891-9b9b-49ad-8aee-07435cb41e6c-delete_snapshot" released by "delete_snapshot" :: held 1.516s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-0ca78905-f899-4088-9de8-e7b227bc0767-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-0ca78905-f899-4088-9de8-e7b227bc0767-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-0ca78905-f899-4088-9de8-e7b227bc0767" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-0ca78905-f899-4088-9de8-e7b227bc0767" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:16 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d5264f-94c1-4302-865a-507c9fb56ee2]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:16 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767 Jul 13 20:51:16 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:16 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767" returned: 0 in 0.346s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:16 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767 Jul 13 20:51:16 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:17 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-0ca78905-f899-4088-9de8-e7b227bc0767" returned: 0 in 0.241s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-0ca78905-f899-4088-9de8-e7b227bc0767" released by "delete_volume" :: held 0.640s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:17 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] Created reservations ['4a29b488-3cb1-4539-b724-b64cfa2c563c', '6812d555-792d-4c68-88c6-5c182f312950', 'abe3f460-4812-4185-881b-981ba565b379', 'fad1b90d-7408-4f76-af81-1fd0507f2032'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:51:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:51:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:51:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:17 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:51:17 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:17 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.248s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:17 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:51:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] Deleted volume successfully. Jul 13 20:51:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6cb4358c-cb6b-4bfc-bfd3-89c421013532 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-0ca78905-f899-4088-9de8-e7b227bc0767-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Flow 'volume_create_manager' (e896d5b0-d138-4d0d-beda-68a499ae29b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c1d5b89-5c24-466e-8cd9-a684d136d2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c1d5b89-5c24-466e-8cd9-a684d136d2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-645773835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbdd89f6-daf8-4510-8ac3-2e83f0deffe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c38df1850474d9a82d8fc73b3b0553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:51:18Z,use_quota=True,user_id='ffe1c94cc7714b9b8648f410124784e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8a1ce8-d092-49ab-85e2-93128c25811a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8a1ce8-d092-49ab-85e2-93128c25811a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118606f5-da2f-4eb0-854a-7e71e39fa68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118606f5-da2f-4eb0-854a-7e71e39fa68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbdd89f6-daf8-4510-8ac3-2e83f0deffe2', 'volume_name': 'volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6892e81-871d-48ea-8d92-86edec638fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6892e81-871d-48ea-8d92-86edec638fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c1c632-81f5-4772-be32-d8d3356d1263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:18 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Volume cbdd89f6-daf8-4510-8ac3-2e83f0deffe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2', 'volume_size': 1} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-645773835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbdd89f6-daf8-4510-8ac3-2e83f0deffe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c38df1850474d9a82d8fc73b3b0553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:51:18Z,use_quota=True,user_id='ffe1c94cc7714b9b8648f410124784e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Creating volume cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:51:18 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:18 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 1073741824 Jul 13 20:51:18 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:18 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 1073741824" returned: 0 in 0.434s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:18 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 Jul 13 20:51:18 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:18 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2" returned: 0 in 0.240s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c1c632-81f5-4772-be32-d8d3356d1263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3990c4f0-788e-4231-bebc-bfeb172b5f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:18 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Volume volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 (cbdd89f6-daf8-4510-8ac3-2e83f0deffe2): created successfully Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3990c4f0-788e-4231-bebc-bfeb172b5f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Flow 'volume_create_manager' (e896d5b0-d138-4d0d-beda-68a499ae29b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:51:18 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e3cefac8-2d81-4260-ade8-0becfb64e902 tempest-ProjectMemberTests-1245199771 None] Created volume successfully. Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:18 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:51:18 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:19 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.252s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:51:19 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 20:51:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 20:51:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dc53dd73-c0ec-4ec3-b360-5ef4fd5f88a5 None None] thread info: [<_MainThread(MainThread, started 130592765014144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 20:51:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-670843ff-6295-42c6-936f-be3662a3843d tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-670843ff-6295-42c6-936f-be3662a3843d tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-670843ff-6295-42c6-936f-be3662a3843d tempest-ProjectMemberTests-1245199771 None] Creating offline snapshot 9835b216-fa88-482b-b303-1f8d35e37485 of volume cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:51:19 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b2a510-2b3b-4e64-82d1-42f59c0ffaf7]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-670843ff-6295-42c6-936f-be3662a3843d tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:19 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 Jul 13 20:51:19 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:19 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-670843ff-6295-42c6-936f-be3662a3843d tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2" returned: 0 in 0.347s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-670843ff-6295-42c6-936f-be3662a3843d tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:19 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485 1G Jul 13 20:51:19 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:19 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-670843ff-6295-42c6-936f-be3662a3843d tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485 1G" returned: 0 in 0.396s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-670843ff-6295-42c6-936f-be3662a3843d tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:19 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485 Jul 13 20:51:19 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:20 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-670843ff-6295-42c6-936f-be3662a3843d tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485" returned: 0 in 0.288s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:20 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-670843ff-6295-42c6-936f-be3662a3843d tempest-ProjectMemberTests-1245199771 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485 is being set with open permissions: ugo+rw Jul 13 20:51:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-670843ff-6295-42c6-936f-be3662a3843d tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:20 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485 Jul 13 20:51:20 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:20 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-670843ff-6295-42c6-936f-be3662a3843d tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485" returned: 0 in 0.238s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-670843ff-6295-42c6-936f-be3662a3843d tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:20 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.info Jul 13 20:51:20 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:20 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-670843ff-6295-42c6-936f-be3662a3843d tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.info" returned: 0 in 0.254s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:20 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-670843ff-6295-42c6-936f-be3662a3843d tempest-ProjectMemberTests-1245199771 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.info is being set with open permissions: ugo+rw Jul 13 20:51:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-670843ff-6295-42c6-936f-be3662a3843d tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:20 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.info Jul 13 20:51:20 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:21 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-670843ff-6295-42c6-936f-be3662a3843d tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.info" returned: 0 in 0.237s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-670843ff-6295-42c6-936f-be3662a3843d tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.839s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:21 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-670843ff-6295-42c6-936f-be3662a3843d tempest-ProjectMemberTests-1245199771 None] Create snapshot completed successfully Jul 13 20:51:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-9835b216-fa88-482b-b303-1f8d35e37485-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-9835b216-fa88-482b-b303-1f8d35e37485-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-9835b216-fa88-482b-b303-1f8d35e37485" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-9835b216-fa88-482b-b303-1f8d35e37485" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] Deleting offline snapshot 9835b216-fa88-482b-b303-1f8d35e37485 of volume cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:51:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] snapshot_file for this snap is: volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:51:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca696dc4-9d23-4f7f-a91b-4a0f916c2b33]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:21 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485 Jul 13 20:51:21 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:21 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485" returned: 0 in 0.347s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:51:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[62760895-19c5-4e02-a9ae-83c50b15bf62]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:21 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 Jul 13 20:51:21 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:22 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2" returned: 0 in 0.340s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:22 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485 Jul 13 20:51:22 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:22 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485" returned: 0 in 0.325s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:22 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485 Jul 13 20:51:22 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:22 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2.9835b216-fa88-482b-b303-1f8d35e37485" returned: 0 in 0.246s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-9835b216-fa88-482b-b303-1f8d35e37485" released by "_delete_snapshot" :: held 1.348s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2" released by "delete_snapshot" :: held 1.370s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:22 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] Created reservations ['b53d634c-02d6-4b79-a3ad-a6df2533db3d', '313a4633-1c8a-4519-9f0c-615170be8451', 'c3e7fd7c-725b-42d4-8159-a5c1491a582a', '9ada5883-4129-410b-90ee-20fbb380c3e1'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:51:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] Delete snapshot completed successfully. Jul 13 20:51:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bcd26eae-87a1-4da6-b5c3-b7fb33595460 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-9835b216-fa88-482b-b303-1f8d35e37485-delete_snapshot" released by "delete_snapshot" :: held 1.494s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:23 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dc4c80-b378-48c7-bc9f-194d21eb33bc]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:23 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 Jul 13 20:51:23 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:23 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2" returned: 0 in 0.345s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:23 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2 Jul 13 20:51:23 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:24 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2" returned: 0 in 0.238s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2" released by "delete_volume" :: held 0.636s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:24 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] Created reservations ['5ec5821e-8a5c-4676-8f91-946dd60e2505', 'bcc224fd-e88f-49a4-a7b6-d900f68f89b5', '66679df2-8f2d-4009-ad97-64373eacef07', 'cd46fe02-f95d-45f3-9a32-9b4363849de2'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:51:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:51:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:51:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:24 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:51:24 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:24 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.238s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:24 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:51:24 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] Deleted volume successfully. Jul 13 20:51:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a3017734-f9bf-4db6-bb2e-c8c0a5d5a8a2 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-cbdd89f6-daf8-4510-8ac3-2e83f0deffe2-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Flow 'volume_create_manager' (ad5eadfb-fde8-4af9-b3f4-c018675b53fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77abb351-8ec9-4b9b-b057-73d4cf34dcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77abb351-8ec9-4b9b-b057-73d4cf34dcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-123348793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71d1d124-ed3c-464d-b43d-2fe7c5753a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c38df1850474d9a82d8fc73b3b0553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:51:25Z,use_quota=True,user_id='ffe1c94cc7714b9b8648f410124784e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4841f6b-3fb8-4642-b9bf-529dea82cd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4841f6b-3fb8-4642-b9bf-529dea82cd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c2df6a-1d61-4601-b9da-b845b054ef7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c2df6a-1d61-4601-b9da-b845b054ef7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71d1d124-ed3c-464d-b43d-2fe7c5753a04', 'volume_name': 'volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857b3bbc-2e95-4c30-9110-dbcd5a4c914f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857b3bbc-2e95-4c30-9110-dbcd5a4c914f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09463d1a-2d2f-414b-bc70-9c5e7b8d4855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:25 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Volume 71d1d124-ed3c-464d-b43d-2fe7c5753a04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04', 'volume_size': 1} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-123348793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71d1d124-ed3c-464d-b43d-2fe7c5753a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c38df1850474d9a82d8fc73b3b0553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:51:25Z,use_quota=True,user_id='ffe1c94cc7714b9b8648f410124784e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Creating volume 71d1d124-ed3c-464d-b43d-2fe7c5753a04 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:51:25 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:25 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04 1073741824 Jul 13 20:51:25 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:25 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04 1073741824" returned: 0 in 0.413s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:25 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04 Jul 13 20:51:25 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:25 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04" returned: 0 in 0.240s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09463d1a-2d2f-414b-bc70-9c5e7b8d4855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c3a54d-f868-453b-9f21-2c168da361e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:25 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Volume volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04 (71d1d124-ed3c-464d-b43d-2fe7c5753a04): created successfully Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c3a54d-f868-453b-9f21-2c168da361e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Flow 'volume_create_manager' (ad5eadfb-fde8-4af9-b3f4-c018675b53fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:51:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-393a8e6f-8850-48fe-a647-e42518241acf tempest-ProjectMemberTests-1245199771 None] Created volume successfully. Jul 13 20:51:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4135932f-2dfe-4313-a269-fdeb5f368fb8 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4135932f-2dfe-4313-a269-fdeb5f368fb8 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4135932f-2dfe-4313-a269-fdeb5f368fb8 tempest-ProjectMemberTests-1245199771 None] Creating offline snapshot 49038b7e-2bd6-490b-b400-125e00a86904 of volume 71d1d124-ed3c-464d-b43d-2fe7c5753a04 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:51:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a349e28-f382-4e1d-a16e-119cc6afefb3]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4135932f-2dfe-4313-a269-fdeb5f368fb8 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:26 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04 Jul 13 20:51:26 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:26 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4135932f-2dfe-4313-a269-fdeb5f368fb8 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04" returned: 0 in 0.357s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4135932f-2dfe-4313-a269-fdeb5f368fb8 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:26 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904 1G Jul 13 20:51:26 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:26 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4135932f-2dfe-4313-a269-fdeb5f368fb8 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904 1G" returned: 0 in 0.378s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4135932f-2dfe-4313-a269-fdeb5f368fb8 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:26 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904 Jul 13 20:51:26 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:27 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4135932f-2dfe-4313-a269-fdeb5f368fb8 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904" returned: 0 in 0.305s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:27 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-4135932f-2dfe-4313-a269-fdeb5f368fb8 tempest-ProjectMemberTests-1245199771 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904 is being set with open permissions: ugo+rw Jul 13 20:51:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4135932f-2dfe-4313-a269-fdeb5f368fb8 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:27 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904 Jul 13 20:51:27 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:27 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4135932f-2dfe-4313-a269-fdeb5f368fb8 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904" returned: 0 in 0.235s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4135932f-2dfe-4313-a269-fdeb5f368fb8 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:27 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.info Jul 13 20:51:27 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:27 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4135932f-2dfe-4313-a269-fdeb5f368fb8 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.info" returned: 0 in 0.242s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:27 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-4135932f-2dfe-4313-a269-fdeb5f368fb8 tempest-ProjectMemberTests-1245199771 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.info is being set with open permissions: ugo+rw Jul 13 20:51:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4135932f-2dfe-4313-a269-fdeb5f368fb8 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:27 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.info Jul 13 20:51:27 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:27 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4135932f-2dfe-4313-a269-fdeb5f368fb8 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.info" returned: 0 in 0.235s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4135932f-2dfe-4313-a269-fdeb5f368fb8 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4135932f-2dfe-4313-a269-fdeb5f368fb8 tempest-ProjectMemberTests-1245199771 None] Create snapshot completed successfully Jul 13 20:51:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-49038b7e-2bd6-490b-b400-125e00a86904-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-49038b7e-2bd6-490b-b400-125e00a86904-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-71d1d124-ed3c-464d-b43d-2fe7c5753a04" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-71d1d124-ed3c-464d-b43d-2fe7c5753a04" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-49038b7e-2bd6-490b-b400-125e00a86904" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-49038b7e-2bd6-490b-b400-125e00a86904" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] Deleting offline snapshot 49038b7e-2bd6-490b-b400-125e00a86904 of volume 71d1d124-ed3c-464d-b43d-2fe7c5753a04 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:51:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] snapshot_file for this snap is: volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:51:28 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1059e042-9587-42b8-971b-373f5fa9e269]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:28 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904 Jul 13 20:51:28 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:28 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904" returned: 0 in 0.346s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:51:28 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[034adf2f-e61a-4d36-a832-2d6c3f67438d]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:28 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04 Jul 13 20:51:28 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:29 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04" returned: 0 in 0.359s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:29 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904 Jul 13 20:51:29 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:29 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904" returned: 0 in 0.328s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:29 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904 Jul 13 20:51:29 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:29 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04.49038b7e-2bd6-490b-b400-125e00a86904" returned: 0 in 0.258s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-49038b7e-2bd6-490b-b400-125e00a86904" released by "_delete_snapshot" :: held 1.377s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-71d1d124-ed3c-464d-b43d-2fe7c5753a04" released by "delete_snapshot" :: held 1.397s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:29 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] Created reservations ['b49d8682-8019-48ea-917a-fc8aa878f594', 'a3e1cc8e-fa64-414d-9c51-e88f3d89e635', '47d213e6-75ce-4ece-aa1b-8198799ecfc2', '42664c39-8a7b-4e50-a1f3-bbd49efe80c3'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:51:29 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] Delete snapshot completed successfully. Jul 13 20:51:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-84d2032a-f81e-4d79-b4d1-9bb10e8ba7a3 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-49038b7e-2bd6-490b-b400-125e00a86904-delete_snapshot" released by "delete_snapshot" :: held 1.523s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-71d1d124-ed3c-464d-b43d-2fe7c5753a04-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-71d1d124-ed3c-464d-b43d-2fe7c5753a04-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-71d1d124-ed3c-464d-b43d-2fe7c5753a04" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-71d1d124-ed3c-464d-b43d-2fe7c5753a04" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:30 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02b2738-ce0f-43f6-a988-4f4d97859c14]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:30 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04 Jul 13 20:51:30 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:30 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04" returned: 0 in 0.345s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:30 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04 Jul 13 20:51:30 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:31 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-71d1d124-ed3c-464d-b43d-2fe7c5753a04" returned: 0 in 0.244s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-71d1d124-ed3c-464d-b43d-2fe7c5753a04" released by "delete_volume" :: held 0.643s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:31 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] Created reservations ['13f74b55-f5f8-4279-b65f-52c5a78db2cc', '746c0e39-04fc-4562-98e8-b0ff2007f456', '64c1d19c-626a-42b8-bbda-f24654ef8daa', '15145e9b-6c38-4395-bcc0-a7c46529aea0'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:51:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:51:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:51:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:31 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:51:31 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:31 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.264s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:31 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:51:31 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] Deleted volume successfully. Jul 13 20:51:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-72f3d4ad-4093-476e-82c6-ada21a58cdc1 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-71d1d124-ed3c-464d-b43d-2fe7c5753a04-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Flow 'volume_create_manager' (dd6c96a2-4f00-4662-acf4-91f6ba847d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7680934-8b6d-4590-8737-cba5386b191f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7680934-8b6d-4590-8737-cba5386b191f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1676789958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e926e1-f842-4416-9f6a-34f22bd28e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c38df1850474d9a82d8fc73b3b0553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:51:32Z,use_quota=True,user_id='ffe1c94cc7714b9b8648f410124784e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5b9c3c-2fe4-4ef6-b028-32e66a6f5626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5b9c3c-2fe4-4ef6-b028-32e66a6f5626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c99e8de-c037-48de-8249-ae34f99caaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c99e8de-c037-48de-8249-ae34f99caaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79e926e1-f842-4416-9f6a-34f22bd28e83', 'volume_name': 'volume-79e926e1-f842-4416-9f6a-34f22bd28e83', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8861589-224f-4ef0-b14a-de57c27120a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8861589-224f-4ef0-b14a-de57c27120a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4a491a-18ea-40ce-b202-80c80c9ec888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:32 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Volume 79e926e1-f842-4416-9f6a-34f22bd28e83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79e926e1-f842-4416-9f6a-34f22bd28e83', 'volume_size': 1} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T18:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1676789958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e926e1-f842-4416-9f6a-34f22bd28e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c38df1850474d9a82d8fc73b3b0553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T18:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T18:51:32Z,use_quota=True,user_id='ffe1c94cc7714b9b8648f410124784e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9da62d53-60a3-43c8-84c4-ed36863f5be8),volume_type_id=9da62d53-60a3-43c8-84c4-ed36863f5be8)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Creating volume 79e926e1-f842-4416-9f6a-34f22bd28e83 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Selected osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 20:51:32 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] casted to osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507 Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:32 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83 1073741824 Jul 13 20:51:32 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:32 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83 1073741824" returned: 0 in 0.437s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:32 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83 Jul 13 20:51:32 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:32 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83" returned: 0 in 0.255s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4a491a-18ea-40ce-b202-80c80c9ec888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e926e1-f842-4416-9f6a-34f22bd28e83', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53128e81-890f-4273-b4f4-02cc5dd7be45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 20:51:32 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Volume volume-79e926e1-f842-4416-9f6a-34f22bd28e83 (79e926e1-f842-4416-9f6a-34f22bd28e83): created successfully Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53128e81-890f-4273-b4f4-02cc5dd7be45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 20:51:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Flow 'volume_create_manager' (dd6c96a2-4f00-4662-acf4-91f6ba847d3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 20:51:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-574842d0-85d5-47ed-b04e-278011b53ceb tempest-ProjectMemberTests-1245199771 None] Created volume successfully. Jul 13 20:51:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-39eb5286-6b72-4aba-a315-74308ee4e9a0 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-39eb5286-6b72-4aba-a315-74308ee4e9a0 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-39eb5286-6b72-4aba-a315-74308ee4e9a0 tempest-ProjectMemberTests-1245199771 None] Creating offline snapshot 6af6c773-ec5a-448e-913c-0ead8d9c2141 of volume 79e926e1-f842-4416-9f6a-34f22bd28e83 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 20:51:33 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd45d11d-6ff1-4662-b26c-9452bbc2fe80]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-39eb5286-6b72-4aba-a315-74308ee4e9a0 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:33 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83 Jul 13 20:51:33 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:33 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-39eb5286-6b72-4aba-a315-74308ee4e9a0 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83" returned: 0 in 0.363s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-39eb5286-6b72-4aba-a315-74308ee4e9a0 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:33 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141 1G Jul 13 20:51:33 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:34 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-39eb5286-6b72-4aba-a315-74308ee4e9a0 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141 1G" returned: 0 in 0.394s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-39eb5286-6b72-4aba-a315-74308ee4e9a0 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79e926e1-f842-4416-9f6a-34f22bd28e83 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:34 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79e926e1-f842-4416-9f6a-34f22bd28e83 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141 Jul 13 20:51:34 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:34 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-39eb5286-6b72-4aba-a315-74308ee4e9a0 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79e926e1-f842-4416-9f6a-34f22bd28e83 -F qcow2 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141" returned: 0 in 0.286s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:34 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-39eb5286-6b72-4aba-a315-74308ee4e9a0 tempest-ProjectMemberTests-1245199771 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141 is being set with open permissions: ugo+rw Jul 13 20:51:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-39eb5286-6b72-4aba-a315-74308ee4e9a0 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:34 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141 Jul 13 20:51:34 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:34 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-39eb5286-6b72-4aba-a315-74308ee4e9a0 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141" returned: 0 in 0.241s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-39eb5286-6b72-4aba-a315-74308ee4e9a0 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:34 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.info Jul 13 20:51:34 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:34 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-39eb5286-6b72-4aba-a315-74308ee4e9a0 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.info" returned: 0 in 0.238s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:34 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-39eb5286-6b72-4aba-a315-74308ee4e9a0 tempest-ProjectMemberTests-1245199771 None] /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.info is being set with open permissions: ugo+rw Jul 13 20:51:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-39eb5286-6b72-4aba-a315-74308ee4e9a0 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:34 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.info Jul 13 20:51:34 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:35 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-39eb5286-6b72-4aba-a315-74308ee4e9a0 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.info" returned: 0 in 0.236s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-39eb5286-6b72-4aba-a315-74308ee4e9a0 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:35 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-39eb5286-6b72-4aba-a315-74308ee4e9a0 tempest-ProjectMemberTests-1245199771 None] Create snapshot completed successfully Jul 13 20:51:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-6af6c773-ec5a-448e-913c-0ead8d9c2141-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-6af6c773-ec5a-448e-913c-0ead8d9c2141-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-79e926e1-f842-4416-9f6a-34f22bd28e83" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-79e926e1-f842-4416-9f6a-34f22bd28e83" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-6af6c773-ec5a-448e-913c-0ead8d9c2141" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-6af6c773-ec5a-448e-913c-0ead8d9c2141" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] Deleting offline snapshot 6af6c773-ec5a-448e-913c-0ead8d9c2141 of volume 79e926e1-f842-4416-9f6a-34f22bd28e83 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 20:51:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] snapshot_file for this snap is: volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 20:51:35 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2853d1-b77b-46e6-984a-6fb0e2a921e8]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:35 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141 Jul 13 20:51:35 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:35 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141" returned: 0 in 0.344s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79e926e1-f842-4416-9f6a-34f22bd28e83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 20:51:35 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec131903-33e7-41b7-b4bf-bc54a5a54eef]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:36 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83 Jul 13 20:51:36 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:36 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83" returned: 0 in 0.344s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:36 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141 Jul 13 20:51:36 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:36 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141" returned: 0 in 0.315s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:36 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141 Jul 13 20:51:36 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:36 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83.6af6c773-ec5a-448e-913c-0ead8d9c2141" returned: 0 in 0.234s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-6af6c773-ec5a-448e-913c-0ead8d9c2141" released by "_delete_snapshot" :: held 1.324s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-79e926e1-f842-4416-9f6a-34f22bd28e83" released by "delete_snapshot" :: held 1.345s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:36 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] Created reservations ['ae2adc0c-85e5-4551-9efe-550e66b8132e', '04e842c4-5083-4eac-943c-d93b9948b900', '0ceb8c89-23d2-4375-a600-89b51ca36a96', '5b186a50-2f53-4b8b-82af-3a7a60ac0063'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:51:36 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] Delete snapshot completed successfully. Jul 13 20:51:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f1c692a0-ce2f-456e-b1d0-8e6d30d74be7 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-6af6c773-ec5a-448e-913c-0ead8d9c2141-delete_snapshot" released by "delete_snapshot" :: held 1.471s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-79e926e1-f842-4416-9f6a-34f22bd28e83-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-79e926e1-f842-4416-9f6a-34f22bd28e83-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "cinder-quobyte-79e926e1-f842-4416-9f6a-34f22bd28e83" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 20:51:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-79e926e1-f842-4416-9f6a-34f22bd28e83" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 20:51:37 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1e8ff8-f72d-43e2-badb-a25e8362f4e4]: (4, 'qcow2') {{(pid=88710) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 20:51:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:37 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83 Jul 13 20:51:37 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:38 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83" returned: 0 in 0.352s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:38 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83 Jul 13 20:51:38 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:38 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113/volume-79e926e1-f842-4416-9f6a-34f22bd28e83" returned: 0 in 0.260s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-quobyte-79e926e1-f842-4416-9f6a-34f22bd28e83" released by "delete_volume" :: held 0.671s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:38 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] Created reservations ['853b3de0-fe48-4f69-b608-45f600364299', '712c190d-db29-4ea1-a974-0aa56db6c683', 'ece2e2a4-b9c4-40c9-b585-e258d91b7dcf', 'b03920eb-feed-4fac-9263-b9b9e7824de5'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 20:51:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 20:51:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 20:51:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 20:51:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29a528a0-565c-446e-872e-53333679e507'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 20:51:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 20:51:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 20:51:38 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113 Jul 13 20:51:38 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 20:51:38 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 13 20:51:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab1490b4a35a162496230ad309f38113" returned: 0 in 0.247s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 20:51:38 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 20:51:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] Deleted volume successfully. Jul 13 20:51:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e276cf3c-7130-42ee-909b-5e8ef005dd22 tempest-ProjectMemberTests-1245199771 None] Lock "cinder-79e926e1-f842-4416-9f6a-34f22bd28e83-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 20:51:48 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=89,cinder:UPDATE=103,cinder:DELETE=9,cinder:INSERT=35 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 20:51:48 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=86,cinder:INSERT=29,cinder:UPDATE=128,cinder:DELETE=9 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}